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Abstract 

This  research  identifies  the  assumptions  and  simplifications  in  the  SPACECAST 
2020  value  model  and  assesses  modifications.  The  model  determines  and  prioritizes  future 
space  systems’  utility  toward  controlling  and  exploiting  space.  This  study  shows  that  the 
assumption  of  using  an  additive  utility  function  is  valid.  This  research  shows  that  the 
mission  areas  are  mutually  utility  independent  allowing  the  use  of  the  multiplicative  utility 
function.  This  research  also  uses  the  multilinear  function,  which  requires  utility 
independence  implied  in  mutual  utility  independence.  This  study  makes  modifications  to 
the  98  SPACECAST  2020  measure  of  merit  scoring  fimctions.  These  scoring  functions 
all  used  the  same  scoring  scale  and  do  not  allow  for  the  determination  of  the  overall 
current  capability  toward  controlling  and  exploiting  space.  This  study  replaced  most  of 
these  functions  with  either  a  concave,  convex,  linear,  or  “S”  scoring  function,  which  has 
expanded  capability  ranges  to  include  current  and  future  capabilities.  The  modified 
scoring  functions  and  alternate  utility  functions  do  not  alter  the  SPACECAST  2020  results 
but  do  improve  upon  the  model.  This  study  also  presents  a  flexible  but  formalized  method 
of  space  system  concept  identification,  which  explicitly  considers  space  operational 
requirements. 


A  METHODOLOGY  TO  ASSESS  THE  UTILITY  OF  FUTURE 

SPACE  SYSTEMS 


1.  Introduction 


1.1  Problem  Statement 

General  Merrill  McPeak,  Air  Force  Chief  of  Staff,  commissioned  the 
SPACECAST  2020  survey  on  10  September  1993.  The  survey’s  mission  was  to 
“envision  what  capabilities  our  country  needs  to  exploit  and  control  space”  and  to 
“identify  innovative  applications  of  space  hardware  that  will  support  national  security” 
(16;Slide  1).  The  study  successfully  identified,  assessed,  and  prioritized  space  systems  and 
technologies  that  the  Air  Force  needs  to  develop  for  and  beyond  the  year  2020.  However, 
the  analysis  model  has  assumptions  and  simplifications  which  could  limit  its  usefulness  as  a 
methodology  to  prioritize  future  space  systems  and  technologies. 

1.2  Background 

The  SPACECAST  2020  study  lasted  for  over  ten  months.  However,  the  ranking 
procedure  for  the  identified  systems  and  technologies  was  completed  in  just  over  a  month. 
The  short  time  available  severely  limited  the  operational  analysis  team. 

There  are  many  techniques  available  to  prioritize  future  space  systems  and 
technologies.  The  easiest  and  least  formal  is  for  a  group  of  experts  to  review  the  systems 
and  technologies  and  produce  a  most  to  least  dear  list.  The  most  difficult,  costly  and  time 
consuming  is  a  cost  and  operational  effectiveness  analysis  (COEA).  However,  such  an 
analysis  would  cost  thousands  of  dollars  and  take  over  a  year  to  complete.  Other 
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techniques  are  qualitative  comparisons,  quantitative  comparisons,  analytic  hierarchy 
process  (AHP),  Value-Focused  Thinking  (VFT),  decision  analysis,  and  Strategy-to-Task. 
The  team  selected  VFT.  VFT  “allowed  the  alternatives  to  be  evaluated  at  an  appropriate 
level  of  detail,  considering  their  level  of  definition,  and  could  be  completed  within  the  time 
available  for  analysis”  (1  :S-4,5).  The  operational  analysis  team  produced  a  value  model 
with  a  hierarchy  structure  with  “broad  categories  at  the  top  level  and  [specified]  the 
desired  qualities  in  greater  detail  al  lower  levels”  (1  ;S-5).  The  desired  qualities  were 
measures  of  merit  (MOMs)  relating  to  space  operational  effectiveness.  This  enabled  the 
team  to  score  the  various  alternatives,  proposed  space  systems,  against  the  measures  of 
merit.  The  model  gave  each  system  a  utility  ranking  indicating  its  contribution  toward 
controlling  and  exploiting  space,  the  overall  objective  of  the  model.  The  value  model 
“gives  a  rational,  traceable,  objective,  and  quantifiable  basis  for  ranking  the  .  .  .  [proposed 
space  systems]”  (l:S-5). 

1.3  Research  Objectives  and  Scope 

The  objective  of  this  thesis  is  to  identify  the  key  assumptions  and  simplifications  in 
SPACECAST  2020  study.  This  thesis  also  makes  modifications  to  the  model  addressing 
the  identified  assumptions  and  simplifications.  Although  this  research  uses  the  space 
systems  and  technologies  identified  in  the  SPACECAST  2020  survey,  it  provides  a 
framework  which  can  apply  to  other  space  systems. 

This  research  does  not  address  the  cost  and  risk  factors  associated  with  future 
space  systems.  Prioritizing  future  systems  just  by  their  utility  towards  controlling  and 
exploiting  space  is  not  sufficient.  Systems  with  high  utilization  may  have  prohibitive  costs 
and  prove  overly  risky  in  their  development. 
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This  thesis  addresses  the  methods  of  achieving  the  utilities  toward  controlling  and 
exploiting  space  and  assumes  that  the  proposed  system  capabilities  in  the  SPACEC  AST 
2020  operational  analysis  are  correct. 

1.4  Use  of  Decision  Analysis,  Value-Focused  Thinking,  and  Regression 
Analysis 

Decision  analysis  is  a  method  of  analysis  that  provides  .  .  insight  about  [a] 
situation,  uncertainty,  objectives,  and  tradeoffs,  and  possibly  yields  a  recommended  course 
of  action”  (2;4).  The  SPACECAST  2020  value  model  uses  VFT,  which  is  a  technique  of 
decision  analysis.  The  value  model  is  a  value  tree  which  shows  the  fundamental  objective 
divided  into  objectives,  sub-objectives,  and  quantifiable  attributes.  The  model  shows  a 
decision  maker  how  each  element  of  a  space  system  contributes  to  its  overall  objective  of 
controlling  and  exploiting  space. 

This  research  uses  regression  analysis  in  order  to  show  that  results  from  different 
utility  functions  are  nearly  strategically  equivalent.  Strategic  equivalence  is  defined  as 
two  value  functions  having  the  same  preferential  ordering  of  alternatives  (6; 8 1).  The 
regression  analysis  shows  that  the  preferences  created  by  one  function  can  be  sufficiently 
explained  by  a  linear  transformation  of  another  utility  function's  preferences. 

This  research  uses  the  computer  spreadsheet*  value  model  created  by  the 
SPACECAST  2020  operations  analysis  team.  It  also  uses  a  mathematical  spreadsheet^ 
for  the  modified  measures  of  merit  defined  and  discussed  in  later  chapters. 


'*  Microsoft® Excel,  version  5.0  (13). 
^Mathcad®  Plus  5.0  (10). 
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1.5  Overview  of  Thesis 

Chapter  II  briefly  outlines  the  SPACECAST  2020  model  and  identifies  the  key 
assumptions  and  simplifications.  It  also  reviews  three  other  methods  used  for  measuring 
effectiveness  and  prioritization. 

Chapter  III  presents  modifications  to  the  SPACECAST  2020  value  model  that 
address  the  issues  presented  in  Chapter  II. 

Chapter  IV  discusses  the  results  derived  using  the  modifications  to  the  value 
model.  It  also  presents  an  analysis  of  the  results. 

Chapter  V  makes  conclusions  and  recommendations  for  future  research  based  on 
the  results  and  analysis  in  Chapter  IV. 
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II.  Modeling  the  Utility  of  Future  Space  Systems  and 

Technologies 


This  chapter  briefly  outlines  the  SPACECAST  2020  model  and  identifies  the  key 
assumptions  and  simplifications.  For  a  detailed  explanation  of  the  SPACECAST  model, 
the  reader  can  review  the  Operational  Analysis  chapter  in  the  SPACECAST  2020  report 
(1  :S-1).  Also,  this  chapter  briefly  reviews  three  other  forecasting  and  prioritization 
methods. 

2.1  SPACECAST  2020  Utility  Model 

In  September  1993,  General  McPeak,  Air  Force  Chief  of  Staff,  wanted  to  “identify 
.  .  .  those  high-leverage  space  technologies  and  systems  that  will  best  support  the 
warfighter”  in  the  next  century  (11).  He  tasked  Air  University  to  form  a  study  group, 
SPACECAST  2020. 

The  SPACECAST  2020  study,  over  the  next  ten  months,  collected  ideas  for  future 
systems  and  technologies.  The  ideas  came  from  military  members,  contractors,  science- 
fiction  writers,  Hollywood  producers,  and  others.  In  all,  they  collected  over  400  ideas. 
With  less  than  two  months  remaining,  the  SPACECAST  2020  staff  called  on  members  of 
the  Operational  Sciences  department  of  the  Air  Force  Institute  of  Technology  (AFIT)  to 
develop  a  model  to  prioritize  these  systems  and  technologies. 

The  operational  analysis  team  answered  the  following  questions  (1  ;S-3): 

1 .  “Which  of  the  SPACECAST  2020  system  concepts  offer  the 
greatest  promise  of  increasing  operational  effectiveness?” 

2.  “What  are  the  technologies  that  would  offer  the  greatest  leverage 
in  making  high-value  system  concepts  into  operational  realities?” 

The  team  encountered  two  major  technical  challenges.  First,  they  had  to  estimate  the 

performance  of  incompletely  defined  systems  that  might  depend  on  technology  that  does 
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not  yet  exist.  Thus,  the  analysis  depended  on  imprecise  human  judgment.  Second,  the 
they  had  to  compare  alternatives  that  were  inherently  different. 

2.1.1  Methodology.  The  SPACECAST  2020  study  uses  a  Value-Focused 
Thinking  (VFT)  approach.  The  operational  analysis  team  considered  other  analysis 
techniques  but  found  them  less  suitable  for  various  reasons  (l:S-4). 

JCS  PUB  3-14,  Military  Space  Doctrine,  is  the  basis  for  the  VFT  model  hierarchy. 
At  the  top  of  the  hierarchy  is  the  goal  of  controlling  and  exploiting  space  from  the  Air 
Force  mission  statement.  JCS  PUB  3-14  fiirther  divides  controlling  and  exploiting  space 
into  four  mission  areas: 


Force  Enhancement  (FE): 
Force  Application  (FA): 


Space  Control  (SC): 


Space  Support  (SS): 


Assisting  terrestrial  military  forces 
Applying  military  force  for  ballistic  missile 
defense,  for  defense  of  terrestrial  forces,  or 
directly  against  enemy  targets 
Monitoring  space  activity,  defending  against 
attacks  in  space,  and  negating  hostile  space 
systems 

Launch,  satellite  control,  and  logistics 
operations 


The  JCS  PUB  3-14  further  divides  each  mission  area  into  force  capabilities  and  the 
team  analyzed  each  capability  to  identify  force  qualities.  *  Figure  1  shows  an  illustration  of 
the  top  levels  of  the  value  model  and  Appendix  A  gives  the  complete  model  (1  :S-27). 

They  selected  force  qualities  that  are,  as  far  as  possible,  “concrete  and  measurable”  and  to 
do  this  they  divided  some  force  qualities  further  (1  ;S-6).  The  model  contains  98  force 


^  The  analysis  team  used  the  terms:  mission  areas,  force  capabilities,  and  force  qualities.  Keeney  and 
RaifFa  use  the  terms:  fundamental  objective,  objectives,  sutobjectives,  and  attributes.  The  model’s 
fundamental  objective  is  to  control  and  exploit  space.  The  mission  areas  are  objectives,  force  capabilities 
are  subobjectives,  and  force  qualities  are  attributes  (6:33-34,43). 
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Control  &  Exploit 
Space 


Figure  1 .  Upper  Levels  of  the  Value  Model 


qualities.  For  each  of  the  98  force  qualities,  the  team  developed  one  or  two  measures  of 
merit  (MOM)  to  score  the  systems. 

2.1.2  Systems  and  Scoring.  Once  the  team  defined  the  value  hierarchy,  they 
incorporated  relative  weights  into  the  model.  They  assigned  weights,  which  sum  to  one, 
to  the  four  mission  areas  first,  and  then  to  the  force  capabilities.  The  force  capability 
weights  sum  to  one  under  each  mission  area.  Similarly,  they  set  up  the  force  quality 
weights  for  each  force  capability. 

The  team  scored  each  system  against  each  of  the  98  MOMs.  The  SPACEC  AST 
2020  study  team  identified  19  systems,  which  results  in  a  maximum  of  1862  judgments.^ 
Two  systems.  Holographic  Projection  and  Asteriod  Negation  were  not  scored  because 
they  did  not  fit  into  the  model  (1;S-12).  They  made  these  judgments  using  the  following 
scale  with  benchmark  levels  of  capability  improvements: 


^  However,  significantly  fewer  judgments  were  actually  required.  One  system  scored  against  only  four 
MOMs  and  one  system  scored  the  most  against  49  MOMs. 
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Improvement  over  current  capability  Score 


None  (Current  Capability) 

0.0 

Minor 

0.1 

Significant 

0.5 

Order  of  magnitude 

0.9 

They  calculated  a  system’s  utility  toward  controlling  and  exploiting  space  using 
Equation  (1). 


m=\  c=\  q=\  s=\ 


where:  i  =  system,  1  <  i  <  19 

k’s  =  weighting  factors 
m  =  mission  area,  1  <  m  <  4 

c  =  force  capability,  Cm  =  number  of  force  capabilities  in  mission 
aream 

q  =  force  quality,  Qc  =  number  of  force  qualities  in  capability  c 

s  =  sub-force  quality,  Sq  =  number  of  sub-force  qualities  in  force 
quality  q 

no  sub-force  qualities  for  a  particular  force  quality  =>  ks  =  1  and 

Umcqs  (Ximcqs)  Umcq(Ximcq) 

Umcqs(ximcqs)  =  scodug  function 

The  utility,  which  is  between  0  and  1,  was  then  scaled  between  1  and  1 1  by 
mulitiplying  by  ten  and  adding  one.  The  addition  of  one  represented  the  linear 
transformation  of  current  capability  from  zero  to  one. 

The  results  show  seven  systems  scored  above  the  rest.  The  remaining  systems 
scored  very  closely.  To  present  the  results,  the  SPACECAST  2020  technology  team 
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System  (in  order  of  increasing  technological  challenge) 
Figure  2.  SPACECAST  2020  System  Rankings 


ordered  the  systems  in  increasing  technological  challenge.  Figure  2  contains  the  key 
results. 

2.1.3  Technology  Ranking.  The  SPACECAST  2020  study  group  also 
identified  and  prioritized  the  high-leverage  technologies  that  would  support  the  warfighter. 
The  technology  team  analyzed  the  19  systems  to  determine  the  required  technologies  in 
each  system.  They  used  a  standardized  list  of  technologies  identified  in  the  DoD 
document  entitled  The  Militarily  Critical  Technologies  List  (MCTL) ,  with  one  addition 
(virtual  reality). 

The  technology  team  assigned  relative  weights,  which  summed  to  100,  to  the 
technologies  in  each  system.  To  get  a  technology's  relative  score,  they  multiplied  the 
weights  by  the  system  utility  and  then  summed  these  products  across  the  systems.  These 
scores  identify  the  technology’s  importance  to  future  space  systems  and  take  into  account 
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Table  1.  Technology  Scores  Against  the  Top  7  Systems  (1:S-19) 


System  Dependence  on  Technologies 

Weighted 

Critical  Technologies 

(Percent) 

Technology 

TAV  OTV  GSRT  HEL  HEW  HPMW  PB 

Score 

High  Performance  Computing 

20  20  5  20  5  5 

15.9 

Micro-mechanical  Devices 

5  20  10  5  15  5  5 

11.3 

Materials  Technology 

30  5 

11.0 

Pulsed  Power  Systems 

40  40 

10.2 

Nav.,  Guidance,  and  Vehicle  Control 

10  5  25  5  5 

9.3 

Robotics,  Controllers,  and  End-Effectors 

20  15 

9.0 

Lasers 

25 

8.1 

Optics 

25 

8.1 

High  Energy  Laser  Systems 

25 

8.1 

High  Power  Microwave  Systems 

45 

6.6 

Power  Systems  and  Energy  Conversion 

20  10 

6.2 

Nonchem.  High  Specific  Impulse  Prop. 

40 

5.9 

Neutral  Particle  Beam 

45 

4.9 

Kinetic  Energy  Systems 

40 

4.9 

Sensors 

25 

4.7 

Data  Fusion 

20 

3.8 

Energetic  Materials 

10 

3.4 

Image  Processing 

15 

2.8 

Electromagnetic  Communications 

10 

1.9 

Vehicle  Survivability 

5 

1.7 

the  relative  importance  of  the  systems  in  controlling  and  exploiting  space.  Table  1  shows 
the  technology  scores  against  the  top  seven  systems. 

2.1.4  Sensitivity  Analysis.  When  the  SPACECAST  2020  study  group  briefed 
these  results,  the  issue  of  the  utility’s  sensitivity  to  weight  values  was  immediately  raised. 
The  operational  analysis  team  performed  a  limited  sensitivity  analysis.  Using  five  other 
weighting  schemes  for  the  mission  areas,  the  team  determined  the  system  utility’s 
sensitivity  to  the  weights.  The  sensitivity  analysis  results  show  that  the  top  seven  systems 
remain  well  above  the  rest  and  in  nearly  the  same  order.  The  system  utilities  are  robust  to 
changes  in  the  weights  (1;S-14,S-18). 

Armed  with  the  system  utilities  and  the  technology  scores,  the  SPACECAST  2020 
study  group  reported  back  to  General  McPeak  and  identified  high-leverage  systems  and 
technologies  the  military  might  pursue.  The  study  group  cautioned  in  their  final  report 
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that  the  systems  and  related  technologies  ranked  were  only  those  which  the  study 
proposed.  Also,  the  operational  analysis  team  completed  their  model  in  only  a  few  weeks 
and  they  could  not  address  all  issues. 

2.2  Limitations  of  the  SPACECAST  2020  Operational  Analysis 

The  operational  analysis  team  had  only  six  weeks  to  complete  their  analysis. 
Therefore,  they  had  to  make  some  simplifying  assumptions. 

2.2.1  Current  Capability  Assessment.  The  SPACECAST  2020  model  does 
not  assess  the  current  capability  of  the  MOMs.  The  operational  analysis  team  set  the 
current  capability  benchmark  level  to  zero  utility. 

2.2.2  Measure  of  Merit  Scoring.  The  SPACECAST  2020  model  scores  each 
system  against  the  scale  outlined  in  Section  2.1.2.  This  is  a  major  simplification  that  the 
team  felt  was  acceptable  given  the  scope  of  the  study.  The  team  did  not  have  time  to 
analyze  each  of  the  98  measures  of  merit  and  determine  its  scoring  curve.  Therefore,  they 
decided  that  each  MOM  would  use  a  scale  from  0  to  1  with  benchmark  levels.  This 
simplified  the  ranking  process  and  allowed  model  completion  in  the  short  time  available. 
However,  one  cannot  reasonably  expect  all  98  MOMs  to  have  the  same  scoring  curve. 
There  are  many  possible  scoring  curves  with  linear,  “S,”  concave,  and  convex  being  the 
most  common  (6:148-158;14;21). 

2.2.3  Additive  Utility  Function.  The  operational  analysis  team,  again  limited 
by  time,  used  an  additive  utility  function.  Additive  utility  functions  are  the  simplest  and 
best  known.  However,  their  use  is  restricted  to  value  models  which  have  additive 
independent  attributes.^ 

^  Keeney  and  Raiffa  discuss  additive  independence  in  detail  (6:230-232). 
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The  value  model  uses  the  following  additive  utility  function  at  the  mission  area 


level  to  assess  each  of  the  19  systems: 


Qc 


c=\ 


q=\ 


^=1 


(2) 


where  the  terms  are  defined  in  Equation  (1).  Equation  (2)  is  Equation  (1)  rewritten  into 
two  parts  to  show  the  additive  utility  function  at  the  mission  area  level  of  the  model.  This 
utility  function  does  not  allow  for  any  cross  terms  that  account  for  interactions  between 
the  mission  areas. 

Multiplicative  and  multilinear  utility  functions  are  not  as  restrictive  and  allow  for 
cross  terms.  However,  they  are  more  complicated  and  require  further  human  judgment  in 
assessing  mission  area  utilities  to  compute  the  cross  term  weights  (6:288-294).  When  the 
mission  area  weights  sum  to  one,  as  is  the  case  with  the  SPACECST  2020  value  model, 
the  cross  term  weights  in  the  multiplicative  and  multilinear  functions  are  all  zero.  The  only 
terms  left  are  the  ones  in  the  additive  utility  function.'* 

The  SPACECAST  2020  value  model  assumes  that  there  are  no  cross  terms 
impl5ang  no  interaction  between  the  mission  areas.  This  is  a  major  simplifying  assumption 
in  the  model.  The  operational  analysis  team  assumed  this  lack  of  synergy  (positive  or 
negative)  between  the  areas  would  not  detract  from  the  validity  of  the  results. 

2.2.4  System  Concept  Selection.  The  operational  analysis  team  cautioned  in 
its  final  report  that  the  results  are  only  for  those  systems  and  technologies  identified  by  the 


^  Keeney  and  Raiffa  show  that  the  additive  and  multiplicative  utility  fimctions  are  a  special  cases  of  the 
multilinear  utility  function  (6:293-294). 
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SPACECAST  2020  study.  The  SPACECAST  2020  study  group  sent  out  a  general  call 
for  ideas  on  future  system  concepts  and  technologies.  The  best  ideas  were  written  up  in 
White  Papers.  The  study  identified  19  systems  and  25  technologies. 

The  technology  team  analyzed  the  papers  and  identified  unique  systems  and  their 
required  technologies.  The  White  Papers  and  the  technology  team  did  not  explicitly 
consider  all  current  or  projected  operational  requirements.  In  order  to  have  a 
comprehensive  study,  there  must  be  a  strong  link  between  current  and  potential  space 
operations  and  the  systems  and  technologies  entered  into  the  value  model. 

2.3  Other  Prioritization  Methods 

A  review  of  how  other  organizations  measure  effectiveness  and  prioritize  future 
systems  and  technologies  shows  that  there  is  no  widely  accepted  model  used  in  the  space 
community.  This  section  briefly  discusses  three  methods  currently  in  use. 

2.3.1  Air  Force  Space  Command’s  Strategy-to-Task.  Air  Force  Space 
Command  (AFSPC)  uses  an  approach  called  Strategy-to-Task  to  prioritize  future  space 
systems  and  technologies.  However,  this  methodology  is  not  completely  formal  and  is  ad 
hoc  at  times  (18). 

Headquarters  AFSPC  staff  officers  first  perform  a  mission  area  assessment.  They 
compare  the  National  Security  Strategy  developed  at  the  Presidential  level  and  the 
National  Military  Strategy  developed  at  the  Joint  Staff  level  with  operational  tasks  and 
measures  of  merit.  These  measures  of  merit  are  at  the  task  level  and  not  at  the  system 
level.  As  an  example,  a  measure  of  merit  might  be  suppression  of  enemy  launch  rates, 
which  is  not  “concrete  and  measurable.”  From  this,  the  staff  officers  determine  what 
AFSPC  should  be  doing  militarily  in  and  from  space. 

They  also  perform  a  mission  needs  analysis.  This  analysis  looks  at  AFSPC’s 
current  capabilities  and  systems.  It  also  reviews  systems  and  technologies  already  in 
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research  and  development.  They  then  compare  this  analysis  to  the  mission  area 
assessment  and  they  create  a  list  of  deficiencies. 


From  this  deficiency  list,  the  staff  officers  then  draft  Mission  Need  Statements 
(MNS).  These  documents  identify  requirements  that  drive  the  need  for  future  systems  and 
technologies  to  eliminate  the  mission  deficiencies.  Because  of  limited  resources,  AFSPC 
cannot  pursue  all  requirements  equally.  They  then  attempt  to  prioritize  the  MNSs. 

They  use  a  number  of  criteria  in  their  ranking  process.  Two  major  criteria  are  the 
Research,  Development,  &  Acquisition  (RD&A)  Priorities  List  and  the  Integrated 
Priorities  List  (IPL).  The  RD&A  Priorities  List  rank-orders  current  systems  and 
technologies  in  research  and  development.  Each  Unified  Command  creates  an  IPL  that 
states  its  prioritization  of  current  systems  and  technologies  to  meet  mission  needs.  These 
documents  in  themselves  do  not  completely  prioritize  the  MNSs. 

The  staff  officers  then  employ  expert  judgment  in  an  informal  group  process  to 
take  all  this  information  and  develop  a  prioritized  list  of  systems  and  technologies. 


STRATEGY-TO-TASK 


Mission  Area  Assessment 


-  National  Strategy 

-  National  Military  Strategy 

-  Operational  Tasks 

-  Measures  of  Merit 


Compare  Mission  Needs  Analysis 

-  Existing  Systems 

-  R&D  Pipeline 

-  Create  Fixes  w/Current 
Systems 


RD&A  Priorities  List  Deficiencies  Integrated  Priorities  List 

I 

“Command  Desires”  Prioritized  List 


Figure  3 .  AF  SPC  ’  s  Strategy-to-T ask 
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However,  the  staff  officers  quite  often  take  into  consideration  “Command  desires”  (18). 
These  desires  are  not  always  quantifiable  nor  concrete. 

Figure  3  shows  a  flow  diagram  for  AFSPC’s  Strategy-to-Task  method.  It  is  very 
good  at  matching  current  and  projected  mission  needs  with  proposed  systems  and 
technologies.  However,  the  method  is  not  always  formal  and  some  judgments  are  not 
concrete  and  measurable. 

2.3.2  Phillips  Laboratory.  Phillips  Labs  (PL)  is  closely  linked  with  AFSPC. 
PL  provides  a  large  portion  of  the  R&D  for  space  systems  and  technologies.  Therefore, 
how  they  prioitize  projects  and  measure  technology  effectiveness  is  relevant  to  this 
discussion. 

Phillips  Labs  uses  three  methods.  First,  the  using  command  may  set  their 
priorities.  As  an  example,  AFSPC  will  give  their  prioritized  list  and  PL  will  structure  their 
projects  accordingly.  Second,  PL  has  computer  modeling  and  simulation  capabilities  for 
measuring  effectiveness.  This  is  good  for  known  systems  and  technologies,  however, 
SPACECAST  2020  is  dealing  with  future  systems  and  technologies  about  which  little  may 


Force  Capabilities 

Technologies 

Tech  1  Tech  2  Tech  3  Tech  4  Tech  5  Tech  6 

Missile  Warning 

Reconnaissance  &  Surveillance 
Spacelift 

C2NORAD 

Satellite  Communications 
Counterspace 

Ballistic  Missile  Defense  C3 
Nuclear  Deterrence 

Satellite  Control 

Conventional  Deterrence 
Navigation 

Space  Surveillance 
Environmental  Sensing 

1.  Does  the  technology  contribute  to  the  mission?  Yes/No 

2.  Score  the  technology: 

No  0 

Yes  1  if  useful  to  the  mission 

2  if  significant  to  the  mission 

3  if  critical  to  the  mission 

3.  Multiply  across  by  mission  weight  and  sum  down  the  technologies 

Scores 

Score  1  Score  2  Score  3  Score  4  Score  5  Score  6 

Figure  4.  Phillips  Lab  Hierarchy 


be  known.  Third,  PL  uses  a  hierarchy  method  similar  to  SPACECAST  2020  but  much 
simpler  (15).  Figure  4  illustrates  this  hierarchy.  AFSPC  provided  their  list  of  force 
capabilities,  from  most  to  least  important.  Phillips  Lab,  in  an  attempt  to  create  a 
prioritization  method,  translated  this  rank-ordered  list  into  an  equal  interval  scale  of 


Force  Capabilities 


Figure  5.  Phillips  Lab  Force  Capability  Weights 


Figure  6.  SPACECAST  2020  Force  Capability  Weights 
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weights.  Figures  5  and  6  compare  these  weights  with  the  SPACEC  AST  2020  force 
capability  weights  (multiplied  by  their  corresponding  mission  area  weights).  Intuitively, 
the  linear  list  of  capabilities  cannot  reasonably  represent  the  actual  weightings.  Some 
force  capabilities  may  be  much  more  or  less  important  than  the  next  on  the  list. 
SPACECAST  2020  weights  seem  more  reasonable.  Phillips  Lab  had  also  realized  this  and 
never  used  this  weighting  scheme  as  a  method  for  technology  prioritization  (15).  PL  still 
uses  this  method,  without  weighting  factors,  as  a  tool  to  measure  a  technologies  impact  on 
the  force  capabilities. 

An  attractive  aspect  of  this  method  is  Phillips  Lab’s  use  of  a  formalized  group 
session,  the  Delphi  Method,  in  answering  the  question  posed  in  the  hierarchy  (15).  The 
Rand  Corporation  developed  the  Delphi  Method  in  the  1950s  specifically  for  the  Air 
Force  as  a  forecasting  tool.  It  employs  “an  iterative  questionnaire  of  experts  .  .  .  [to] 
produce  a  consensus  and  accurate  forecast”  (14:51).  It  is  good  at  producing  a  consensus 
forecast  but  some  raise  doubt  over  whether  or  not  it  is  accurate  (14:51).  Regardless,  it  is 
a  traceable,  formalized  method. 

Phillips  Lab  is  closely  linked  with  AFSPC  on  space  systems  and  technologies. 

They  both  prioritize  their  systems  and  technologies  according  to  their  respective  methods. 
However,  neither  looks  outside  the  military  for  ways  of  forecasting  systems  and 
technologies  for  the  future. 

2.3.3  Private  Sector  Forecasting.  When  making  forecasts  for  the  future, 
corporations  consider  a  multitude  of  issues.  Overriding  all  these  issues  is  the  corporate 
strategic  plan.  The  corporation  uses  the  strategic  plan  as  a  “compass”  to  move  into  the 
future  (5:114). 

Corporations  consider  issues  such  as  current  products,  competition,  market  size, 
corporate  culture,  cost  analysis,  public  demand,  government  policy,  profit  projections,  and 
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many,  many  others.  They  generally  have  experts  available  to  analyze  each  variable, 
employ  forecasting  techniques,  and  determine  the  effect  on  the  corporate  strategy.  They 
then  may  move  in  a  new  “direction”  as  necessary  to  capitalize  on  the  future.  The 
corporation  is  continually  allowing  for  unseen  forces.  Corporations  “prepare  options 
because  [they]  don’t  know  what  [they]  are  going  to  need”  or  have  available  in  the  future 
(9).  Dr.  Joseph  Martino,  a  noted  expert  in  civilian  technology  forecasting,  uses  the 
business  situation  of  1920  as  an  example.  In  1920,  nobody  (or  very  few)  could  possibly 
imagine  the  advances  made  through  1946.  In  those  26  years,  industry  and  the  military 
developed  nuclear  weapons,  television,  radar,  and  jet  engines.  Similarly,  the  year  2020  is 
26  years  in  the  future.  Dr.  Martino  cautions  that  any  forecasting  methodology  must  be 
flexible  to  allow  for  systems  and  technologies  that  we  cannot  image  now. 

2.4  Chapter  Summary.  The  SPACECAST  2020  Study  successfully  identified 
and  prioritized  space  systems  and  technologies  that  could  support  the  warfighter  in  the 
future.  However,  in  its  analysis,  the  operational  analysis  team  made  some  simplifying 
assumptions,  due  to  limited  time.  The  SPACECAST  2020  value  model  does  not 
determine  the  current  level  of  capability  for  the  MOMs.  The  team  assumed  the  98  MOMs 
use  the  same  scoring  function  and  that  the  utility  function  is  additive.  They  cautioned  that 
the  systems  actually  entered  are  not  all  inclusive  and  the  White  Papers  did  not  explicity 
consider  current  and  projected  space  operational  requirements.  However,  they  were 
confident  that  these  assumptions  and  omissions  would  not  reduce  the  completeness  or 
validity  of  the  results.  A  review  of  other  prioritization  techniques  shows  that  there  is  no 
accepted  model  used  by  the  space  community.  The  SPACECAST  2020  model  is  a  step 
foreward  but  more  work  is  needed. 
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III.  Modified  SPACECAST  2020  Value  Model 


This  Chapter  presents  modifications  to  the  SPACECAST  2020  Value  Model  that 
address  the  issues  presented  in  chapter  two.  These  modifications  demonstrate  the  validity 
of  the  SPACECAST  2020  Value  Model  as  a  tool  that  prioritizes  future,  high-leverage 
space  systems  and  technologies. 

3.1  Measure  of  Merit  Scoring  Functions 

This  research  first  addresses  the  assumption  that  all  the  scoring  fimctions  are  the 
same  as  described  in  section  2. 1 .2.  It  identifies  and  reassigns  scoring  functions  to  most  of 
the  98  measures  of  merit.  Then  it  rescores  each  of  the  systems  with  these  new  fimctions. 

3.1.1  Scoring  Functions.  This  research  uses  the  following  four  common 
scoring  functions;  linear,  concave,  convex,  and  “S.”  Figure  7  shows  examples  of  these 
functions. 


■s 

-  -x- 

Concave 

-Linear 

...  a ... 

Convex 

Figure  7.  Example  Scoring  Functions 
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The  linear,  concave,  and  convex  functions  capture  the  three  risk  attitudes  towards 
score  increases  for  some  MOM  increase.  The  attitudes  are  risk-averse,  risk-prone,  and 
risk-neutral.  1 

The  concave  function  (risk-averse)  captures  rapid  score  increases  for  small 
increases  at  low  MOM  levels  with  decreasing  score  gains  at  higher  levels.  The  convex 
function  (risk-prone)  is  just  the  opposite.  It  captures  rapid  score  increases  at  high  MOM 
levels.  The  linear  function  (risk-neutral)  captures  equivalent  score  increases  at  all 
capability  levels. 

The  “S”  curve  is  a  combination  of  the  linear,  concave,  and  convex  functions.  It  is 
convex  at  low  capability  levels,  then  becomes  nearly  linear,  and  then  reaches  a  point  where 
it  is  concave  for  high  capability  levels. 

3.1.2  System  Rescoring.  In  a  group  session,  members  of  the  SPACECAST 
2020  technology  team  and  operational  analysis  team  reviewed  the  measures  of  merit  and 
assigned  new  scoring  functions  to  many. 

Many  of  the  original  measures  of  merit  indicate  which  curve  provides  a  best  fit.  As 


an  example,  the  second  measure  of  merit,  decompressed  megabits  per  second 

(MBits/Sec),  indicates  a  concave  function.  The  original 

scoring  scale  with  benchmark 

levels  is: 

Mbits/Sec 

Score 

300  (Current  Capability) 

0.0 

600 

0.1 

1000 

0.5 

3000 

0.9. 

^  Clemen  gives  a  clear,  non-technical  description  (2:363-368)  and  Keeney  and  Raiffa  give  a  complete, 
technical  discussion  on  risk  attitudes  (6:145-187). 
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-Original  Function 


Modified  Function 


Figure  8.  MOM  #2,  MBits/Sec,  Concave  Scoring  Function 


A  plot  of  the  number  of  Mbits/sec  versus  the  score  clearly  shows  a  concave 
scoring  function  (Figure  8).  This  research  replaces  the  original  scale  with  a  smooth 
concave  curve  (modified  scoring  function). 

Next,  the  group  set  capability  endpoints  for  the  new  curves.  A  few  of  the  original 
SPACECAST  2020  current  and  order  of  magnitude  capabilities  became  the  endpoints. 

For  most,  however,  the  group  chose  entirely  new  endpoints  in  order  to  assign  a  non-zero 
score  to  current  capability  and  to  capture  possible  increases  in  capability  not  yet 
technically  possible. 

The  modified  scoring  function  does  not  return  a  current  capability  score  of  zero  as 
is  always  the  case  in  the  original  model.  Again,  the  second  measure  of  merit  uses  300 
MBits/Sec  equal  to  zero  in  the  original  scoring  function.  The  modified  concave  scoring 
function,  where  x  is  in  Mbits/sec  for  system  i. 
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returns  a  current  capability  score  of  .338  for  300  Mbits/sec  and  a  proposed  capability 
score  unique  to  each  system.  No  system  scores  below  the  current  capability. 

In  some  cases,  the  original  MOM  scoring  fimctions  are  classified  or  cannot  be 
represented  as  an  equation.  An  example,  the  third  MOM,  common  use  system,  uses  the 
following  scoring  scale: 


Commonalitv 

Score 

Little  (Current  Capability) 

0.0 

All  AF  Systems 

0.1 

All  US  Systems 

0.5 

US,  Commercial,  International 

0.9. 

The  commonality  levels  cannot  be  represented  as  an  equation  unless  the  entire  MOM  is 
redefined.  In  those  cases,  this  research  uses  the  original  scoring  functions.  However,  this 
research  modifies  most  of  the  non-numerical  functions  to  assign  a  non-zero  current 
capability  and  to  capture  expanded  capability  ranges.  Appendix  B  contains  the  modified 
scoring  functions  and  the  current  capabilities.  The  results  are  presented  in  Chapter  IV. 

This  model  uses  three  decimal  precision  for  the  MOM  scores.  Due  to  the  nature 
of  the  mathematical  equations,  a  few  measures  of  merit  return  a  current  capability  score  of 
a  few  thousandths  when  it  should  be  zero.  This  discrepancy  does  not  alter  the  results. 
Appendix  C  contains  the  modified  MOM  scores  and  unsealed  system  scores. 

3.2  Alternate  Utility  Functions 

This  research  shows  that  the  use  of  two  less  restrictive,  but  more  complex, 
functions  do  not  change  the  SPACECAST  2020  results.  The  two  alternate  utility 
fimctions  are  the  multilinear  and  multiplicative  utility  functions. 

3.2.1  Independence  Assumptions.  The  multilinear  and  multiplicative  utility 
functions  require  utility  and  mutual  utility  independence,  respectively  (6:288,293). 
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3.2. 1.1  Preferential  Independence.  An  attribute  is  preferentially 
independent  (PI)  of  another  attribute  if  the  utility  of  the  first  does  not  depend  on  the  level 
of  the  second.  As  an  example, 

let  Y  be  the  time  to  completion  of  a  project  and  X  its  cost.  If  we  prefer  a  project 
time  of  5  days  to  one  of  10  days,  assuming  that  the  cost  is  100  in  each  case,  and  if 
we  also  prefer  a  project  time  of  5  days  to  one  of  10  days  if  the  cost  is  200  in  both 
cases,  then  Y  is  preferentially  independent  of  X  .  .  .  (2:477) 

This  research  used  a  simple  dialog,  created  by  Keeney  and  Raiffa,  to  prove  PI 
between  one  attribute  and  the  others,  without  making  any  assessments  (6:299-300).  This 
approach,  with  four  officers  experienced  or  knowledgeable  in  space  operations,  clearly 
showed  Space  Support  is  PI  of  the  others.  The  four  officers  cover  a  wide  range  of 
operational  and  staff  experience.  Three  officers  came  fi'om  space  operations  in  missile 
warning,  space  surveillance,  and  satellite  command  and  control.  One  has  recent 
headquarters  AFSPC  experience.  The  fourth  officer  is  a  pilot  and  knowledgeable  in  space 
operations.  All  four  are  members  of  the  AFIT  Graduate  Space  Operations  degree 
program. 

3.2. 1.2  Utility  Independence.  Utility  independence  (UI)  is  a  stronger 
condition  than  PI  and  more  difficult  to  prove.  UI  is  similar  to  PI  but  the  choices  are  now 
under  uncertain  conditions.  Extending  the  example  above,  lets  assume  you  are  indifferent 
between  a  certain  level  of  Y=  8  or  a  50-50  chance  of  getting  either  Y=5  or  Y=10  at  a 
fixed  level  of  X.  If  your  certain  level  of  Y  does  not  change  when  the  level  of  X  is  changed 
then  Y  is  UI  of  X.  If  X  is  UI  of  Y  then  they  are  mutually  utility  independent  (2:478). 

Using  a  very  similar  approach  as  that  for  PI,  this  research  can  reasonably  claim 
that  Space  Support  is  UI  of  the  others.  The  four  officers  gave  responses  that  indicate  SS 
is  UI  of  the  others.  They  indicated  that  there  are  some  cases  where  SS  is  not  completely 
yi  by  responding  with  certain  levels  of  SS  that  are  not  equivalent  to  each  other. 
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However,  they  always  responded  with  “reasonably  close”  values,  generally  .01  or  .02 
difference,  which  indicate  that  UI  is  a  reasonable  assumption  (6:266).  Given  Space 
Support  is  PI  and  UI  of  the  others,  this  research  shows  that  the  mission  areas  are  mutually 
independent  of  one  another.  ^ 

3.2.2  Multilinear  Utility  Function.  The  multilinear  utility  fimction  has  the 
least  restrictive  criteria  for  its  use.  Each  mission  area  has  to  be  utility  independent  of  the 
others,  which  is  the  case  since  the  mission  areas  are  mutually  utility  independent.  The 
function  is  of  the  following  form,  with  i  indicating  the  system  (6:293); 

U(x,)  =  + 

m=l  m=l  j>m  .  .v 

4  ^  ^ 

m=\ j>ml>j 


The  subscripts),  1,  and  p  also  represent  the  mission  areas.  The  k’s  are  mission  area 
weights  defined  below  and  the  Un,(xim)’s  are  mission  area  utilities  introduced  in  Equation 
(2).  U(xi)  will  be  between  0  and  1 . 

3.2.2. 1  Mission  Area  Utilities.  The  value  model  produces  the  mission 
area  utilities,  Um(xin,)’s,  for  each  system  and  requires  no  further  assessments.  The  mission 
area  utilities  are  the  sum  of  the  products  of  the  MOM  score,  force  quality  weight(s),  and 
force  capability  weight  under  each  mission  area  (Appendix  D). 

3.2.2.2  Mission  Area  Weights.  The  mission  area  weights  require  mission 
area  utility  assessments.  Mission  area  utility  assessments  are  a  decision  maker’s  relative 
value,  scaled  from  0  to  1,  of  the  utility  of  all  the  possible  combinations  of  the  mission 
areas  set  to  maximum  capability  with  the  others  at  minimum  capability.  As  an  example, 

^  Keeney  and  Raiffa  show  that  mutual  utility  independence  of  the  attributes  is  equivalent  to  one  attribute 
being  PI  and  UI  of  the  others  (6:292). 
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U(FE,FA,SC,SS)  =  U(1,0,1,0)  is  a  decision  maker’s  relative  utility  of  FE  and  SC  set  to 
maximum  capability  and  FA  and  SS  set  to  minimum  capability.  Appendix  E  contains  the 
defining  equations,  the  judgments,  and  the  subsequent  weights.  If  the  one-way  weights 
(i.e.,  kpE,,  kpA,  ksc,  and  kss)  sum  to  one,  the  multilinear  function  collapses  to  the  additive 
function.  Therefore,  the  one-way  weights  do  not  sum  to  one  and  begin  vvdth  .25  for  Force 
Enhancement  and  keep  similar  relative  magnitudes  to  the  original  mission  area  weights 
(i.e.,  .37,  .19,  .22,  and  .22).  They  are  also  all  positive  because  the  four  mission  areas 
contribute  to  and  do  not  detract  from  controlling  and  exploiting  space. 

3.2.3  Multiplicative  Utility  Function.  The  multiplicative  utility  function 
requires  mutually  utility  independence  between  the  mission  areas.  The  multiplicative 
utility  function  is  of  the  following  form,  again  using  the  same  notation  as  before  (6:289): 


4  4 

U(X,)  =  'Llin,K(Xin.)  +  kY,kJMxJUjiXy)  + 


k^T.^r,kjk,U„(XiJUj(Xij)u,(X„)  +  (5) 

m=I 

j>m 

1>J 

k  (x,„  )Uj  (Xy  )u,{x„  )Uj,  ix,p ). 


This  function  uses  the  same  one-way  mission  area  weights  and  mission  area  utilities  as  the 
multilinear  function.  However,  it  requires  one  additional  weight,  k.  This  weight  is  the 
solution  to  the  following  equation  (6:347-348): 


l  +  k=  Y\(}  +  kkJ.  (6) 

m= fe,fa,sc,ss 


Again,  the  k^’s  are  the  one-way  weights.  Appendix  E  shows  k  =  1 .88  for  the  given 
scaling  constants. 
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3.3  SPACECAST  2020  Mission  Area  Weights 

As  Section  2. 1 .4  indicates,  there  is  concern  over  the  system  score  sensitivity  to 
mission  area  weights.  The  SPACECAST  2020  study  addresses  this  concern  by  using 
alternate  weighting  schemes  showing  the  utility  scores  are  robust  to  the  weights.  This 
research  uses  a  formalized  group  technique  to  arrive  at  accepted  weights. 

3.3.1  Nominal  and  Delphi  Group  Techniques.  Delbecq  and  Van  De  Ven 
developed  the  Nominal  Group  Technique  in  the  late  1960s  and  early  1970s  (14:55). 

It  has  a  systems  engineering  rigor  .  .  .  [and]  is  increasing  in  popularity  as  a  group 
method,  especially  in  technology  companies.  It  is  best  used  when  structure  is 
needed,  such  as  in  the  following  circumstances:  when  certain  people  who  can  be 
argumentative  and  domineering  must  be  included  in  the  group,  when  people  who 
do  not  know  each  other  are  together,  when  people  who  do  not  like  each  other  are 
together,  when  managers  and  staff  analysts  are  mixed,  when  the  topic  is  sensitive 
or  controversial,  and  when  corporate  politics  need  to  be  managed  carefully 
(14:55). 

In  the  assessment  of  the  mission  area  weights,  the  group  could  exhibit  many  or  all 
of  these  characteristics.  Also,  many  decision  makers  must  accept  the  weights  and  this 
method  addresses  this  possible  controversy.  However,  it  does  not  allow  for  an  iterative 
process  to  arrive  at  a  consensus. 

The  Delphi  Method  uses  a  carefully  constructed  questionnaire  given  to  a  group  of 
experts  not  necessarily  convened  in  one  place.  The  moderator  collects  the  responses, 
tabulates  the  results,  and  sends  them  back  to  the  group  members.  At  this  time,  the 
moderator  also  sends  the  names  of  the  other  respondents  to  each  group  member.  The 
moderator  repeats  these  steps  until  the  respondants  reach  a  consensus  or  until  it  is  obvious 
they  cannot  reach  one  (14:51-52). 

The  Delphi  Method  and  the  Nominal  Group  Technique  both  contain  aspects  that 
are  favorable  to  assigning  weights  to  the  mission  areas.  The  Delphi  Method  allows  for  an 
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iterative  process  and  the  Nominal  Group  Technique  handles  group  dynamics  very  well. 
This  research  uses  a  mixture  of  these  aspects  to  create  a  new,  formalized  technique 

3.3.2  Modified  Group  Technique.  This  procedure  derives  the  following  five 
steps  from  the  Delphi  and  Nominal  Techniques: 

1 .  The  group  moderator  provides  a  detailed  briefing  on  the  topic. 

2.  The  group  members  decide  on  their  weights  in  private  using  only  their 
knowledge  and  experience. 

3.  Each  group  member,  in  turn,  gives  their  weights  to  the  group  and  the 
moderator  records  the  high  and  low  values.  The  moderator  places  the  high  and  low 
weights  on  a  blackboard  so  the  entire  group  can  see  them.  The  group  members  with  the 
high  and  low  values  explain  their  decisions  with  no  interruptions  from  the  others.  This 
forces  quiet  members  to  voice  their  opinions  and  keeps  the  domineering  members  quiet. 

4.  The  group  then  discusses  the  weights.  Here  group  interaction  flows,  within 
reason.  This  discussion  distributes  each  individual’s  ideas  and  reasons  for  their  decisions. 
It  makes  others  aware  of  issues  that  they  may  not  have  considered. 

5.  The  moderator  repeats  steps  two  through  four  until  each  group  member  is 
confident  that  they  will  not  change  their  weights.  The  moderator  collects  each  member’s 
weights  and  performs  statistical  analysis  to  generate  means,  standard  deviations,  and 
confidence  intervals. 

3.3.3  Results.  This  research  convened  a  group  of  ten  officers  with 
considerable  knowledge  and  experience  in  space  operations.  To  ensure  unbiased  weights, 
the  members  were  unaware  of  the  results  of  the  SPACECAST  2020  study.  Table  2  shows 
the  descriptive  statistics  on  the  SPACECAST  2020  weights  and  the  group’s  mean 
weights.  The  SPACECAST  2020  statistics  are  derived  with  a  sample  of  six  responses. 
After  participating  in  the  modified  technique,  this  group  gave  weights  to  the  mission  areas 
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Table  2.  Modified  Technique  Statistics 


Statistic 

Force 

Enhancement 

Force 

Application 

Space  Control 

Space  Support 

Mean: 

Group 

38.1 

15.1 

21.2 

25.6 

SPACECAST 

36.67 

19.17 

22.5 

21.67 

Standard  Deviation 

5.16 

4.92 

6.12 

2.58 

Minimum 

30 

10 

15 

20 

Maximum 

40 

25 

30 

25 

95%  Confidence 

32.54-40.80 

15.24-23.10 

17.60-27.40 

19.60-23.74 

that  were  almost  the  same  as  those  in  the  SPACECAST  2020  study.  However,  the 
group’s  Force  Application  and  Space  Support  weights  are  just  outside  the  95%  confidence 
interval. 


3.4  System  Selection 

AFSPC  should  generate  new  system  concepts  and  decide  which  ones  to  enter  into 
the  value  model.  AFSPC  should  use  a  formalized  procedure  which  provides  a  strong  link 
to  current  and  projected  space  operational  requirements.  The  procedure  must  also  be 
fiexible  and  allow  for  unforeseen  missions  and  systems  in  the  future.  This  research 
outlines  such  a  procedure. 

3.4.1  White  Paper  System  and  Brainstorming.  The  SPACECAST  2020 
White  Paper  system  was  good  at  generating  new  missions  and  system  concepts.  AFSPC 
should  send  out  a  call  to  other  commands,  researchers,  colleges  and  universities,  writers, 
movie  producers,  and  any  group  with  an  interest  in  space  to  generate  ideas  for  missions 
and  systems  in  space  operations.  AFSPC  should  not  limit  the  creativity  of  these  groups  by 
putting  requirements  on  the  potential  ideas.  Also,  AFSPC  should  convene  a  group  of  its 
own  “experts”  for  a  brainstorming  session  to  generate  ideas. 
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3.4.2  Link  to  Operational  Requirements.  AFSPC  already  uses  Strategy- 
to-Task  to  identify  mission  deficiencies.  However,  it  does  not  have  a  formalized  process 
of  ranking  the  systems.  The  SPACECAST  2020  value  model  could  be  used.  AFSPC  can 
take  the  missions  and  systems  generated  through  the  White  Paper  system  and  its  own 
ideas  and  match  them  to  the  identified  deficiencies.  If  no  system  concept  matches  an 
identified  deficiency,  AFSPC  can  generate  one  specifically  for  it.  The  value  model  can 
then  prioritize  the  systems  for  the  AFSPC  decision  makers.  Then  they  can  compare  the 
priorities  given  to  those  systems  that  meet  current  deficiencies,  meet  future  missions,  or 
provide  improved  capabilities.  This  provides  the  decision  makers  with  some  flexibility. 

3.4.3  Flexibility.  This  procedure  allows  for  flexibility  in  the  decision  making 
process.  The  decision  makers  may  decide  to  spend  resources  pursuing  a  system  that  does 
not  meet  a  current  deficiency  but  provides  a  future  mission  or  significantly  improved 
capability.  Also,  by  calling  for  White  Papers  and  convening  its  own  group  every  year  or 
two,  AFSPC  ensures  that  they  incorporate  missions  and  capabilities  not  yet  imaged  into 
the  decision  process.  As  necessary,  they  can  add  and  delete  force  capabilities,  force 
qualities,  and  measures  of  merit  and  reassign  the  relative  weights. 
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IV.  Results  and  Analysis 


The  purpose  of  the  model  is  to  compute  and  prioritize  the  relative  utilities  of  future 
space  systems  towards  controlling  and  exploiting  space.  Although  the  magnitude  of  the 
utilities  provides  insight  into  a  system’s  contribution,  the  relative  ranking  of  the  utilities  is 
more  important.  The  rankings  tell  decision  makers  which  systems  contribute  the  most  to 
controlling  and  exploiting  space. 

This  research  uses  the  modified  scoring  functions  to  compute  the  modified  utility 
rankings  with  the  additive,  multilinear,  and  multiplicative  utility  functions.  It  uses  the 
SPACECAST  2020  mission  area  weights  in  the  additive  utility  function  to  compare  the 
modified  results  to  the  SPACECAST  2020  results. 

This  chapter  shows  that  the  additive  utility  function  is  nearly  strategically 
equivalent  (i.e.,  same  preferential  ordering)  to  the  multilinear  and  multiplicative  utility 
functions  (6:81).  This  research  validates  this  claim  using  regression  analysis.  The 
regression  analysis  uses  the  unsealed  utilities.  ^ 

The  SPACECAST  2020  study  shows  that  the  additive  utility  function  is  robust  to 
changes  in  the  mission  area  weights.  This  chapter  shows  that  the  multilinear  and 
multiplicative  utility  functions  are  also  robust  to  changes  in  the  mission  area  weights  and 
mission  area  utility  assessments. 

4.1  Additive  Utility  Function 

4.1.1  Results.  Figure  9  shows  the  magnitudes  and  the  relative  rankings  of  the 
modified  utilities.  These  results  are  derived  using  the  SPACECAST  2020  mission  area 
weights,  the  modified  scoring  functions,  and  the  additive  utility  fimetion.  The  results  show 

^  This  avoids  explaining  in  the  regression  analysis  the  different  scalings  used  by  the  SPACECAST  2020 
and  the  modified  models. 
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System 


B  System  Utility 
□  Current  Capability  =  1 .46 


Figure  9.  Additive  Utility  Function  Results 


that  the  same  seven  systems  score  above  the  others  as  in  the  SPACECAST  2020  results. 
There  are  three  distinctive  groupings  consisting  of  the  HEL  and  TAV  at  the  top;  the 
GSRT,  HPMW,  OTV,  KEW,  and  PB  in  the  middle;  and  the  rest  closely  grouped  at  the 
bottom. 

This  model  calculates  the  overall  current  capability.  As  described  in  Section  3.1.2, 
the  modified  scoring  functions  equate  no  capability  to  a  zero  score.  The  model  gives 
current  capability  a  non-zero  score  unless  there  is  no  current  capability  for  a  particular 
MOM.  The  overall  current  capability  is  also  computed  using  the  SPACECAST  2020 
mission  area  weights,  the  modified  scoring  functions,  and  the  additive  utility  function.  The 
scaled  current  capability  is  1.46  (scaled  by  multiplying  by  10). 

The  model  produces  utility  magnitudes  between  zero  and  one  which  are  then 
scaled  between  zero  and  ten.  Also  described  in  Section  3. 1.2,  a  system’s  utility  is  the 
weighted  sums  of  the  MOM  proposed  capability  scores.  For  scaling,  the  system  score  is 
multiplied  by  10.  This  is  a  linear  transformation  and  produces  no  change  in  the  rankings. 
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Figure  10.  Comparison  of  the  Additive  Utility  Function  Results 


4.1.2  Analysis.  Figure  10  shows  the  SPACECAST  2020  utilities  (X  horizontal 
axis)  plotted  against  the  modified  utilities  (Y  vertical  axis).  If  the  magnitudes  and  relative 
rankings  are  exactly  the  same,  the  points  would  lie  upon  a  straight  line  through  the  origin 
with  a  slope  of  one  (45  degrees).  Since  the  utility  magnitudes  are  not  as  important  as  the 
relative  rankings,  strategic  equivalence  between  the  utility  fimctions  is  desired. 

Keeney  and  Raiffa  show  that  two  utility  functions  are  strategically  equivalent  if 
there  exist  constants  B  and  C  >  0  such  that  Y  =  C*X  +  B  for  all  Xj.^  Figure  10  shows 
that  the  utilities  do  not  lie  on  a  perfectly  straight  line  because  some  of  the  system  rankings 
changed.  It  also  shows  three  distinctive  groupings.  They  represent  the  groupings  of 
systems  discussed  in  Section  4.1.1.  This  pattern  repeats  itself  in  the  results  of  the  different 
utility  fimctions. 

Figure  10  shows  some  systems  changed  positions  which  indicates  strict  strategic 
equivalence  does  not  hold.  However,  a  regression  analysis  shows  that  a  straight-line 
approximation  is  sufficient  to  explain  the  modified  results  and  suggests  using  the  simpler 

2  Keeney  and  Raiffa  give  a  complete  proof  of  strategic  equivalence  between  utility  functions  (6: 144) 
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model.  A  straight-line  regression  forced  through  the  origin,  Y  =  C*X  (B  =  0),  produces 
the  constant,  C,  required  for  strategic  equivalence.^  If  the  regression’s  statistical  results 
strongly  support  the  linear  approximation,  then  the  two  utility  functions  are  nearly 
stategically  equivalent.  Using  the  following  hypothesis: 

Null:  C  <  0  (i.e.,  the  modified  results  are  not  a  positive  linear  transformation  of 
the  SPACECAST  results) 

Alternate:  C  >  0  (i.e.,  the  modified  results  are  a  positive  linear  transformation  of 
the  SPACECAST  2020  results), 

a  regression  analysis  produces  the  results  in  Table  3. 


Table  3.  Regression  Analysis  of  the  Additive  Utility  Functions 


Coefficient 

95%  Confidence  Interval 

Students’  t/P  Value 

Correlation 

.9716 

.9409-1.002 

67.14/0.0000 

.9965 

.9982 

The  regression  statistics  strongly  support  the  calculated  value  of  C.'*  The 
students’  t  statistic  is  much  greater  than  the  rejection  value  of  1 .746  required  for  a  5% 
significance  level.^  The  rejection  values  are  minimum  values  for  the  statistics  to  support  a 
given  significance  level.  A  students’  t  of  67. 14  has  a  p-value  of  less  than  0.0000  indicating 
strong  evidence  to  reject  the  null  hypothesis.  The  p-value  is  the  smallest  significance  value 
for  which  the  null  hypothesis  is  rejected  (12:447).  The  statistic  says  that  the  linear 
equation,  with  C  =  .972,  explains  99.65%  of  the  error  between  the  predicted  and  observed 
values  based  on  the  data  obtained.  The  correlation  value  indicates  that  the  two  data  sets 


^  A  regression  analysis  not  forced  through  the  origin  does  not  support  a  non-zero  intercept,  B,  as  Figure 
10  indicates. 

^  Since  there  is  only  one  coefficient,  the  F  and  adjusted  regression  statistics  provide  no  added 
contribution  to  the  argument. 

^  Rejection  values  for  the  student’s  t  statistic  are  taken  from  tables  proved  by  Mendenhall,  et.  al. 
(12:761,764-773).  The  significance  level  is  the  probability  of  rejecting  the  null  hypothesis  when  it  is  true 
(12:430). 
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are  99.82%  linearly  correlated  (4:43-44)  which  forther  supports  rejecting  the  null 
hypothesis. 

The  points  corresponding  to  the  HEL  and  TAV  have  standard  residuals  of  2.29 
and  1.84,  respectively.  These  residuals  are  the  largest  for  all  the  systems  and  lie  well 
within  the  range  of  +/-4,  which  is  the  range  of  expected  standard  residuals  (17). 

Another  test  statistic  specifically  designed  to  test  whether  or  not  two  distributions 
(utility  functions)  produce  uncorrelated  (and  the  opposite,  correlated)  preference  rankings 
is  Spearman’s  Rho  (p)  (3:243-248).  It  uses  the  following  hypothesis: 

Null:  The  distributions  are  uncorrelated 

Alternate:  There  is  a  tendency  for  the  functions  to  produce  the  same 
preferential  rankings. 

Given  a  sample  of  17  values  and  a  5%  significance  level,  rho  must  be  larger  than 
.4118  to  reject  the  null  hypothesis  (3 :390).  Indeed,  rho  is  .9877  for  the  two  sets  of  utility 
values  indicating  that  the  two  utility  functions  produce  nearly  the  same  preferential 
rankings.  Rho  is  equal  to  one  if  the  two  functions  produce  the  exact  same  preferential 
rankings.  In  this  case,  rho  =  .9877  indicates  nearly  identical  rankings. 

Although  strict  strategic  equivalence  does  not  hold,  the  regression  results  and  the 
Spearman’s  rho  test  statistic  indicate  that  the  modified  utilities  using  the  modified  scoring 
functions,  additive  utility  function,  and  the  SPACECAST  2020  mission  area  weights  are 
sufficiently  explained  by  the  SPACECAST  2020  model. 

4.2  Multilinear  and  Multiplicative  Utility  Functions 

The  results  and  analysis  of  the  multilinear  and  multiplicative  functions  are  divided 
into  two  sections.  The  first  section  deals  with  the  results  derived  using  the  SPACECAST 
2020  MOM  scores.  The  second  section  deals  with  the  results  derived  using  the  modified 
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MOM  scoring  fianctions.  The  results  and  analysis  are  similar  to  the  ones  for  the  additive 
utility  function. 

4.2.1  SPACECAST  2020  Data.  Using  the  mission  area  utility  assessments 
and  mission  area  weights  derived  in  Appendix  E,  the  multilinear  and  multiplicative 
functions  produce  results  which  are  almost  exactly  the  same  (Figure  11).  Only  one  set  of 
utilities  is  shown  in  Figure  1 1  for  clarity;  however,  there  is  no  loss  of  detail.  Only  one 
system,  GSRT,  has  a  difference  in  utility  (.02)  produced  by  the  functions  of  more  than 
.01.  The  two  functions  also  produce  results  very  similar  to  the  SPACECAST  2020 
additive  function  results.  The  multilinear  and  multiplicative  utilities  are  scaled  from  one  to 
eleven  like  the  SPACECAST  2020  additive  function  results.  The  multilinear  and 
multiplicative  functions  give  a  scaled  overall  current  capability  of  one  because  the 
SPACECAST  2020  MOM  scoring  functions  define  it  as  such. 


SPACECAST  2020  Data 


System 


Figure  1 1 .  Results  of  the  Multilinear  and  Multiplicative  Utility  Functions 

(SPACECAST  2020  Data) 
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SPACECAST  2020  Data 


Additive  Utilities 

Figure  12.  Comparison  of  the  Multilinear  and  Multiplicative  to  the  Additive  Utility 

Function  (SPACECAST  2020  Data) 

Figure  12  plots  both  the  multilinear  and  multiplicative  derived  utilities  (Y  vertical 
axis)  against  the  SPACECAST  2020  utilities  (X  horizontal  axis).  The  grouping  pattern  is 
the  same  as  in  Figure  10.  It  is  difficult  to  see  the  separate  points  because  they  are  in  nearly 
the  same  location. 

Figure  12  shows  that  there  is  more  variability  in  the  results  and  strict  strategic 
equivalence  does  not  hold;  however,  a  regression  analysis  shows  that  the  multilinear  and 
multiplicative  functions  are  sufficiently  explained  by  the  SPACECAST  2020  additive 
utility  function.  Table  4  gives  the  results  of  the  regression  analysis  using  the  same 
hypothesis  as  Section  4. 1 .2.  Not  shown  in  table  4,  the  correlation  between  the  multilinear 
and  multiplicative  functions  is  99.99%. 

Again,  all  of  the  regression  statistics  strongly  support  rejecting  the  null  hypothesis 
indicating  that  the  multilinear  and  multiplicative  functions  are  sufficiently  explained  by  the 
additive  utility  function. 
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Table  4.  Regression  Analysis  of  the  Multilinear  and  Multiplicative  Utility  Functions  Vs 


the  Additive  Function 

'SPACECAST  2020  Data) 

Function 

H 

95%  Confidence 
Interval 

Students’  H  P-Value 

■i 

Correlation 

Multilinear 

.661 

.6014-.7212 

23.40/0.0000 

.9716 

.9857 

.660 

.6077-.7129 

26.62/0.0000 

.9779 

.9889 

The  largest  standard  residual  for  the  multilinear  function  is  2.42  (KEW)  and  for  the 
multiplicative  function  is  2.41  (TAV).  Again,  both  are  well  within  the  expected  +/-4 
standard  residual  range. 

Spearman’s  rho  statistics  for  the  multilinear  and  multiplicative  functions  against  the 
additive  function  are  the  same,  .9853.  This  is  expected  because  their  individual  results  are 
nearly  identical.  Again,  rho  strongly  supports  rejecting  the  null  hypothesis  indicating  that 
the  multilinear  and  multiplicative  functions  produce  nearly  the  same  preferential  rankings 
as  the  additive  function.  Rho  for  the  multilinear  against  multiplicative  function  is  1,  as 
expected. 

The  results  of  the  regression  analysis  and  Spearman’s  rho  statistic  indicate  that 
there  is  strong  evidence  to  reject  the  null  hypothesis.  The  multilinear  and  multiplicative 
utility  functions  are  sufficiently  explained  by  and  produce  nearly  the  same  rankings  as  the 
SPACECAST  2020  model.  Therefore,  the  multilinear  and  multiplicative  functions  are 
nearly  strategically  equivalent  to  SPACECAST  2020  additive  utility  function. 

4.2.2  Modified  MOM  Scoring  Function  Data.  Again,  the  multilinear  and 
multiplicative  utility  functions  produce  results  which  are  almost  exactly  the  same  and  are 
very  similar  to  those  of  the  additive  utility  function.  Since  the  modified  scoring  functions 
are  used,  the  current  capability  is  computed  and  scaled  (i.e.,  multiplied  by  10).  The 
multilinear  and  multiplicative  functions  both  produce  an  overall  current  capability  of  1 . 12. 
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4.00 


Modified  Scoring  Function  Data 


System 


Figure  13.  Results  of  the  Multilinear  and  Multiplicative  Utility  Functions 
(Modified  Scoring  Function  Data) 

Modified  Scoring  Functions 


Additive  Utilities 


Figure  14.  Comparison  of  the  Multilinear  and  Multiplicative  to  the  Additive  Utility 
Function  (Modified  Scoring  Function  Data) 

The  function  results  are  multiplied  by  ten  and  plotted  in  Figure  13.  Figure  14  plots  their 
unsealed  utilities  (Y  vertical  axis)  against  the  unsealed  additive  utilities  (X  horizontal  axis) 
Again,  Figure  13  shows  only  one  set  of  utility  values  for  clarity.  Two  systems, 
HPMW  and  GSRT,  have  the  largest  difference  of  .02.  Also,  Figure  14  plots  both  sets  of 
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utilities  but  it  is  difficult  to  see  the  individual  points  because  they  are  in  nearly  the  same 
location. 

Again,  Figure  14  shows  almost  the  same  variability  and  the  same  grouping  pattern 
as  in  Figure  12,  Table  5  shows  the  results  of  the  regression  analysis  for  the  multilinear  and 
multiplicative  utilities  as  a  linear  function  of  the  additive  utilities.  The  same  null  and 
alternate  hypothesis  are  used.  The  regression  statistics  again  strongly  support  rejecting 
the  null  hypothesis,  indicating  that  the  multilinear  and  multiplicative  fimctions  are 
sufficiently  explained  by  the  additive  utility  function.  The  multilinear  and  multiplicative 
functions  are  99.99%  correlated. 


Table  5.  Regression  Analysis  of  the  Multilinear  and  Multiplicative  Utility  Functions  Vs 
the  Additive  Function  (Modified  Scoring  Function  Data) _ 


Function 

H 

95%  Confidence 
Interval 

Students’  t/P-Value 

■1 

Correlation 

Multilinear 

.648 

.5952-.7010 

25.95/0.0000 

.9768 

.9883 

.647 

.5953-.6995 

26.35/0.0000 

.9775 

.9887 

The  largest  standard  residuals  for  both  functions  are  2.53  and  2.50  for  the  KEW. 
Again,  these  residuals  are  well  within  the  expected  +/-4  standard  residual  range. 

Spearman’s  rho  statistic  is  again  the  same,  .9779,  for  both  functions  against  the 
additive  function.  Again,  it  strongly  indicates  that  the  multilinear  and  multiplicative 
functions  produce  the  same  prefential  rankings. 

The  results  of  the  regression  analysis  and  Spearman’s  rho  statistic  indicate  that  the 
results  of  multilinear  and  multiplicative  functions  are  sufficiently  explained  by  and 
produce  nearly  the  same  rankings  as  the  additive  function  using  the  modified  scoring 
function  data.  This  shows  that  the  multilinear  and  multiplicative  utility  functions  are 
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nearly  strategically  equivalent  to  the  additive  utility  function  using  the  modified  MOM 
scoring  functions. 

4.2.3  Summary.  In  both  cases,  SPACECAST  2020  results  and  modified 
results,  the  multilinear  and  multiplicative  fiinction  results  are  sufficiently  explained  by  their 
corresponding  additive  utility  function.  Also,  the  modified  utilities  using  the  additive 
function  is  sufficiently  explained  by  the  SPACECAST  2020  additive  model.  These  results 
indicate  that  there  is  no  gain  in  using  the  more  complicated,  albeit,  more  appropriate 
functions.  Even  though  additive  independence  between  the  mission  areas  has  not  been 
proven,  there  is  no  loss  of  accuracy  in  assuming  it  exists.  However,  before  this  research 
can  assert  that  the  additive  utility  function  accurately  calculates  and  prioritizes  the 
systems’  utility  towards  controlling  and  exploiting  space,  it  must  show  the  multilinear  and 
multiplicative  functions  are  robust  to  changes  in  the  mission  area  utility  assessments. 

4.3  Sensitivity  to  Mission  Area  Utility  Assessments 

The  SPACECAST  2020  study  showed  that  the  additive  utility  function  is  robust  to 
changes  in  the  mission  area  weights.  This  research  shows  that  the  same  is  true  for  the 
multilinear  and  multiplicative  utility  functions. 

The  mission  area  weights  for  the  multilinear  and  multiplicative  functions  are 
fimctions  of  the  mission  area  utility  assessments.  Since  the  mission  area  utility 
assessments  are  subjective  but  based  on  experience  and  knowledge  in  space  operations, 
this  research  assumes  that  the  assessments  in  Appendix  E  are  baseline  values.  In  order  to 
show  sensitivity,  this  research  increased  and  decreased  each  of  the  one-way  assessments 
(#’s  1,2,3,  and  4  in  Table  6,  Appendix  E)  by  10%  of  their  value.  The  same  relative  values 
for  the  two-way,  three-way,  and  four- way  assessments  were  retained.  The  multiplicative 
function  weight,  k,  was  recalculated  in  each  case.  This  procedure  produced  eight  sets  of 
utilities  for  both  the  multilinear  and  multiplicative  functions.  Figures  15  and  16  clearly 
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j 

I 

show  that  the  multilinear  and  multiplicative  fimctions  (scaled  utilities)  are  robust  to 
changes  in  the  mission  area  utility  assessments.  They  show  the  same  grouping  pattern  and 
near  linear  plotting  of  the  utilities. 

Since  the  multilinear  and  multiplicative  utility  fonctions  are  robust  to  changes  in 
the  mission  area  utility  assessments,  this  research  concludes  that  the  additive  utility 
function  is  sufficient  to  accurately  calculate  and  prioritize  the  systems’  utility  towards 
controlling  and  exploiting  space. 


♦  FE-10%FE 
H  FE+10%FE 
aFA-10%FA 
XFA+10%FA 
X  SC-10%SC 

•  SC+10%SC 
+  SS-10%SS 
-  SS+10%SS 


0  12  3  4 


Additive  Utility 


Figure  15.  Multilinear  Function  Sensitivity 
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Multiplicative  Utilities 
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Additive  Utilities 

Figure  16.  Multiplicative  Function  Sensitivity 
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V.  Conclusions  and  Recommendations 


This  chapter  discusses  conclusions  based  upon  the  results  of  the  analysis  and 
makes  recommendations  for  possible  future  research. 

5.1  Conclusions 

The  purpose  of  this  research  was  twofold  :  it  was  to  identify  the  key  assumptions 
and  simplifications  made  in  the  SP  ACEC  AST  2020  value  model  and  to  make 
modifications  addressing  those  assumptions  and  simplifications.  This  research  makes  the 
following  conclusions: 

1 .  The  SPACECAST  2020  current  capability  is  arbitrarily  set  to  zero  and  a 
system’s  utility  cannot  be  compared  to  it.  The  SPACECAST  2020  measure  of  merit 
scoring  functions  do  not  sufficiently  represent  the  capabilities  and  utilities  of  the  98 
measures  of  merit.  The  modifications  made  using  the  concave,  convex,  linear,  and  “S” 
utility  curves  more  closely  represent  actual  capabilities  and  utilities.  They  allow  for  the 
calculation  of  the  overall  current  capability  and  for  future  capabilities  not  yet  possible.  A 
system’s  utility  score  can  be  directly  compared  to  current  capability  and  the  gain  in  utility 
toward  controlling  and  exploiting  space  can  be  determined.  These  modifications  give  the 
same  results  as  the  SPACECAST  2020  study. 

2.  The  additive  utility  function  is  sufficient  in  calculating  and  prioritizing  the 
utilities  towards  controlling  and  exploiting  space.  The  additive  utililty  fijnction  requires 
additive  independence  between  the  mission  areas;  however,  directly  proving  additive 
independence  is  difficult.  This  research  shows  that  the  missions  areas  are  mutually  utility 
independent  of  one  another  which  allows  for  the  use  of  the  multilinear  and  multiplicative 
utility  functions.  The  analysis  of  the  results  shows  that  they  are  nearly  strategically 
equivalent  to  the  additive  utility  function. 
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3.  This  research  shows  that  care  must  be  taken  when  selecting  and  evaluating 
systems  concepts.  It  outlines  a  procedure  for  generating  new  system  concepts  through 
brainstorming  and  the  White  Paper  system.  It  asserts  that  combining  the  model  using  the 
additive  utility  function  and  the  modified  scoring  functions  with  Strategy-to-Task  creates  a 
formalized  procedure  for  identifying  mission  deficiencies  and  prioritizing  the 
recommended  systems.  Also,  by  using  this  model  on  a  regular  basis,  it  will  allow  for 
flexibility  in  the  decision  making  process.  It  enables  decision  makers  to  incorporate  as  of 
yet  unimaginable  capabilities  into  the  decision  making  process. 

5.2  Recommendations 

This  research  improves  upon  the  SPACECAST  2020  model  which  prioritizes 
future  space  systems.  However,  more  research  is  required  in  the  following  areas: 

1.  The  modified  MOM  scoring  functions.  They  are  not  all  easily  expressed  as 
equations.  Each  MOM  not  expressed  as  an  equation  should  be  redefined  so  as  to  allow 
for  an  equation.  Further  research  should  use  expert  judgment  to  more  accurately  identify 
the  proper  utility  curve,  current  level  of  capability,  and  maximum  capability. 

2.  Mission  area  weights.  The  modified  group  technique  should  be  used  with  a 
statistically  “large”  group  of  experts  in  the  space  operations  field  to  assign  the  mission 
area  weights.  This  procedure  is  also  appropriate  for  all  weights  in  the  model  hierarchy. 

3.  System  capabilities.  Further  research  should  use  expert  judgment  to  more 
accurately  determine  the  system  concepts’  proposed  capabilities. 

4.  As  mentioned  in  Chapter  I,  this  thesis  does  not  address  the  cost  and  risk  factors 
associated  with  future  space  systems.  This  model  calculates  and  prioritizes  future  space 
systems’  utility  towards  controlling  and  exploiting  space.  A  system  may  score  at  the  top 
of  the  prioritization  list  but  its  cost  may  be  prohibitive.  Likewise,  a  system  may  prove  to 
risky  to  pursue  its  development. 
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APPENDIX  A.  SPACECAST  2020  Value  Model 


APPENDIX  A.  SPACECAST  2020  Value  Model 


APPENDIX  B.  Modified  Scoring  Functions 


MOM  #1  #  Links  in  theater  x  =  1 ,20..  10000  Links  y(x)  :=  .488  atan(.0005  x) .33 


Current  capability 
y(10)  =0.332 


MOM #2 Decompressed MB/sec  x  =0, 10..  3000  MB/sec  y(x)  :=.728  atan(.00167  x) 


MOM  #3  Common  use  systems 


Current  capability 
y(  300)  =0.338 


MOM  #4  Level  of  secure  links 


None  =  0.0 

Little  =  0.25  (current) 

All  AF  systems  =  0.5 

All  US  systems  =  0.75 

US,  commercial,  International  =  1 


None  =  0.0 
Corps  =  0. 1  (current) 
Division  =  .25 
Battalion  =  .5 
Platoon  =  75 
Soldier  =  1.0 


MOM  #5  Crisis  availability  x  :  =  0 ,  .0 1 . .  1 


Maximum  capability  reassessed  to  be  at 
the  soldier  level. 

Probability  y(x)  :=.34565  atan(15.916  x-  8)  +  .5 

Current  capability 

"Very  good"  assessed  to  be  .95 

y(.95)  =0.995 
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MOM  #6  Receiver  size/cost 


X  1 ,2..  100  Unitless 


y(x)  :=  .728  atan(.05  x) 


Handheld/SlOOO  (current) 
Handheld/SlOO 
Wristwatch/$50 
One  chip 


y(25)  =0.652 
y(50)  =0.867 
y(75)  =0.954 
y(lOO)  =  1 


X 


MOM  #7  Location  precision  x  :=100,99..0 Meters 


y(x)  :=(e' 


Current  capability 
y(10)  =0.607 


MOM  #8  Resistance  to  CM 

None  =  0.0  (current) 
Antijam  =  0.1 
Antijam/antispoof  =  0.5 
AJ/AS/antivirus  =  0.9 


MOM  #9  Auto  image  processing 


x  =0, 1 ..  100  Unitless  y(x)  :=.728  atan(.05  x) 


Some  change  Det  (current) 
Search,  recognition 
Human  review  only 
Full  auto  report  to  user 


y(25)  =0.652 
y(50)  =0.867 
y(75)  =0.954 
y(  100)  =  1 


MOM  #10  Not  used 

MOM#ll  Imageinterpretability;#12  Area  per  unit  time;  #13  %  time  data  available  -  Classified:  Use 
SPACECAST  2020  Weights 

MOM  #  14  Not  used 
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MOM  #15  Multispectral  Bands 


x  :=  1,100..  10000  Bands 


y(x)  =  .582  atan(.0005  x)  -  .2 


MOM #16  Prediction  x  =  0, 1 ..  365  Days 


Current  capability 
y(5)  =0.201 


y(x)  :=  .6599  atan(.05  x) 


Current  capability 
y(l)  =  0.033 

This  curve  is  steeper  than  the  other  concave 
functions  to  capture  most  of  the  utility  in  the  first 
few  months. 

The  maximum  capability  reassessed  to  be  365  days. 


MOM  #17  Multispectral  revisit  time  x  =  1 00 


MOM  #18  Instant  WX  information 
None  =  0.0 

Cloud  cover  =  0. 1  (current) 
Cloud/precipitation  =  0.5 
Cloud/precipitation/winds  =  0.9 


99..0Days  y(x) 

Current  capability 
y(7)  =0.705 

"Hours"  set  to  .2  days 

MOM  #19  Amount  of  control 
None  =  0.0 

Clear  fog  =  0. 1  (current) 

Modify  patterns  =  0.5 
WX  on  demand  =  0.9 

Current  capability  reassessed  to  be  clearing  fog. 


MOM  #20  Not  Used 
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MOM  #21  Amount  of  detail 


MOM  #22  Geodetic  precision  -  Classified:  Use 
SPACECAST  2020  Weights 


None  =  0.0 

Surface  terrain  =  0.25  (current) 

Trafficability  =  0.5 

All  structures  =  0.75 

Full  resource  characterization  =  1 

MOM#23  Time  to  get  new  map  x  :=  100,99..  ODays  y(x)  :  =  e 


MOM  #24  coverage 
None  =  0.0 

Limited  global  ICBM  =  0.25  (current) 
Limited  global  MRBM  =  0.5 
Global  MRBM  =  0.75 
Global  SRBM/cruise  =  1 


Current  capability 
y(60)  =0.05 
"Months"  set  to  60  days. 


MOM  #25  What  and  Where  -  Classified:  Use 
SPACECAST  2020  weights 


MOM  #26  Time  to  tactical  warning 


x  :=20,19..0  Minutes  y(x)  :=e'’^^'’‘ 

Current  capability 
y(10)  =0.03 


MOM  #27  Resistance  to  CM 

None  =  0.0  (current) 
Antijam  =  0.1 
Antijam/antispoof  =  0.5 
AJ/AS/antivirus  =  0.9 


MOM  #28  Covered  area 

None  =  0.0  (current) 
Most  of  Eurasia  =  0. 1 
Half  of  Globe  =  0.5 
World  =  0.9 


MOM  #29  Track  accuracy 


MOM  #30  ID/Discrimination 


None  =  0.0  (current) 
•3mm  atmosphere  =  0. 1 
3  m  everywhere  =  0.5 
1  m  everywhere  =  0.9 


None  =  0.0  (current) 

Warning  of  RV/decoy  =  0. 1 
Limited  discrimination  =  0.5 
Mid-course  discrimination  =  0.9 
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MOM  #3 1  Qualitative  judgment 

None  =  0.0  (current) 

No  1  -point  failures  =  0.1 

Some  capacity  concerted  attack  =  0.5 

Full  capacity  major  power  attack  =  0.9 


MOM#32  PK  x  :  =  0,.01..  1  Probability  y(x)  :=.364  atan(10x- 5)+ .5 

Current  capability 
y(0)  =8.212*10“^ 

Rounded  to  0.0 

Note:  All  PK  functions  are  set  to  "S"  curves  because  the 
original  SPACECAST  2020  data  exhibits  a  slight  "S"  shape. 

X 


MOM  #33  Required  warning  time  x  =20, 19..  0  days  y(x)  := e" 

Current  capability 
y(20)  =0.001 

SPACECAST  2020  current  capability  set  at  no  capability. 
Modified  scale  has  utility  starting  at  20  days. 

20  10  0 
X 


MOE  #34  Defended  area 

None  =  0.0  (current) 
City  =  0.1 
Regional  =  0.5 
Global  =  0.9 
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MOM  #35  Rvs  handled  at  a  time 


X  =0,100..  10000  RVs  y(x)  =  .645  atan(.005  x) 


Current  capability 
y(0)=0 

This  curve  is  steeper  than  the  other  coneave  curves  to  capture  the 
utility  expressed  in  the  SPACECAST  2020  scale. 

Maximum,  "entire  enemy  force,"  set  to  10000  RVs  and  "a  few"  set 
to  10. 


MOM  #36  Covered  area 

None  =  0.0  (current) 

Most  of  Eurasia  =  0. 1 
HalfofGlobe  =  0.5 
World  =  0.9 

MOM  #38  ID/Discrimination 

None  =  0.0  (current) 

ID  ground  targets  =  0.25 
Discrimination  mobile  ground  =  0.5 
Discrimination  ground/air  targets  =  0.75 
People  =  1 

Maximum  reassessed  to  be  "people." 


MOM  #37  Track  accuracy 

None  =  0.0  (current) 

3  m  unmoving  target  =  0. 1 
3  m  large  moving  target  =  0.5 
1  m  ground  or  air  targets  =  0.9 

MOM  #39  Qualitative  judgement 

None  =  0.0  (current) 

No  1  -point  =  0. 1 
Some  capacity  =  0.5 
Full  capacity  =  0.9 


MOM#40  PK  x  :=0,.01..  1  Probability  y(x)  =  .364  atan( lOx- 5)  +  .5 

Current  capability 
y(0)  =8.212*10"^ 

Rounded  to  0.0 


MOM  #41  Required  warning  time  x  =20, 19..0  days  y(x)  :=e 


.34x 


Current  capability 
y(20)  =0.001 
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MOM  #42  Covered  area 


MOM  #43  Covered  area 


MOM  #44  Track  accuracy 


None  =  0.0  (current) 
City  =  0.1 
Regional  =  0.5 
Global  =  0.9 


None  =  0.0  (current) 
Most  of  Eurasia  =  0. 1 
Half  of  globe  =  0.5 
World  =  0.9 


None  =  0.0  (current) 

3  m  unmoving  target  =  0. 1 
3  m  large  moving  target  =  0.5 
1  m  ground  or  air  targets  =  0.9 


MOM  #45  ID/Discrimination 

None  =  0.0  (current) 

ID  ground  targets  =  0.1 
Discrimination  mobile  ground  =  0.5 
Discrimination  ground/air  targets  =  0.9 
People  =  1 

Maximum  set  to  the  "people"  level. 


MOM  #46  Qualitative  judgement 

None  =  0.0  (current) 

No  1  -point  failure  =  0. 1 

Some  capacity  concerted  attack  =  0.5 

Full  capacity  major  power  attach  =  0.9 


MOM  #47  PK 


X  :  =  0,.01..  1  Probability  y(x)  :=.364  atan(10x-  5)-i-  .5 


Current  capability 
y(0)=  8.212*  10~ 
Rounded  to  0.0 


MOM  #48  Required  warning  time 


x  ;=20,19..0  days  y(x)  :=e 

Current  capability 
y(20)  =0.001 

See  notes  on  MOM  #33 


MOM  #49  Covered  area 

None  =  0.0  (current) 
City  =  0.1 
Regional  =  0.5 
Global  =  0.9 
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MOM  #50  Percent  of  Space 


X  =0, 1 ..  100  Percent 


y(x)  :=  .728  atan(.05  x) 


y(30)  =0.715 
y(50)  =0.867 
y(80)  =0.965 
y(lOO)  =  1 

Concave  chosen  because  most  utility  is  in 
Earth/Lunar  orbits. 


90%  of  Earth  orbit  (current) 
All  Earth  orbits 
Cislunar  orbits 
Heliocentric  orbits 


MOM#51  Timetoview  x  =40,39.. 0  Hours  y(x)  :=e'  *’’‘ 


"Tens  of  hours"  (current)  y(  20)  =0.135 

"1-6  hours"  y(6)  =0.549 

"10-60  hours"  y(l)  =0.905 


"<1  minute" 


y  J_  =0.998 
\60/ 


MOM  #52  Qualitative  judgment 

Single  point  failures  =  0.0  (current) 

No  1  -point  failures  =  0.1 

Some  capacity  against  concerted  attack  =  0.5 

Full  capacity  against  major  power  attack  =  0.9 


MOM#53  Time  to  restore  x  :=  100,99.  ODays  y(x)  :=e 


Current  capability 
y(60)  =0.05 


too  50  0 

X 


MOM  #54  Target  sample  distance;  #55  Percent  of  objects  ID'd  -  Classified:  Use  SPACECAST  2020 
Weights 


B-8 


MOE  #56  Avg  #  objects  lost 


x  :=  1000,995..  0  Objects  y(x)  :=e 


Current  capability 
y(  500)  =0.082 


MOM #57  Response  time  x  :=10,9.9..0  Hours  y(x)  :  =  e 


-.7-x 


Current  capability 
y(5)=0.03 


MOM  #58  Spectral  Range 
None  =  0.0 

Selected  bands  =  0.25  (current) 

Double  #  bands  =  0.5 
All  major  bands  =  0.75 
All  radio  frequencies  =  1 

MOM  #59  Average  decoys  per  spacecraft  x:=0,.l..  10  Decoys  y(x)  :=  .645  atan(5x) 


Current  capability 
y(0)=0 

Steeper  concave  function  used  to  capture  the 
SPACECAST  2020  utility. 

0  5  10 
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MOM  #60  PK 


X  =0,.01 ..  1  Probability 


y(x)  =  .364  atan( lO  x-  5)+  .5 


MOM  #6 1  Qualitative  judgment 

Single  point  failures  =  0.0  (current) 

No  1  -point  failures  =  0.1 

Some  capacity  against  concerted  attack  =  0.5 

Full  capacity  against  major  power  attack  =  0.9 


Current  capability 
y(0)=  8.212- 10~ 
Rounded  to  0.0 


MOM  #62  Probability  of  detection  x  =  1  ,.9..  0  Probability  y(x)  =  1  -  x 


Current  capability 
y(l)=0 


MOM  #63  Sure  safe  watts  on  target  x  =  0 , 


.01..  1  Megawatts  y(x)  :=  .5805  atan(50  x)  +  .1 
Current  capability 
y(M0“*)  =0.1 

This  curve  is  steeper  than  other  concave  curves  to 
capture  the  the  utility  expressed  in  the  SPACECAST 
2020  scale. 
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MOM  #64  Percent  S/C  with  crypto 


X  =  0,  .1 ..  1  Probability 


y(x)  :=x 


MOM  #65  Time  to  produce  state  vector  after  launch 


Current  capability 
y(.9)  =0.9 


X  =48,47. 5. .0  hours  y(x)  :  = 

Current  capability 
y(24)  =0.035 


MOM  #66  Percent  of  S/C  x  : = 0 , 1 . .  1 00  Percent 


y(x)  :=.728  atan(.05  x) 


Current  capability 
y(0)=0 

The  SPACECAST  2020  data  shows  a  slight  "S"  curve  but  it 
was  felt  that  a  concave  function  captures  this  utility  best. 


MOM  #67  Average  number  of  shots  per  target 


X  -0, 1 ..  lOOOShots/target  y(x)  =  .728  atan(.005  x) 

Current  capability 
y(0)=o 

Maximum  set  at  1000 
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MOM  #68  Pk/shot  x  :  =  0 ,  .0 1 . .  1  Probability 


y(x)  :=  .364  ataii( lO  x-  5)  +  .5 


MOM#69  Percent  of  hostile  systems  which  can  be  targeted  x  =0,1..  100  Probability  y(x)  :=.728  atan(.05x) 

Current  capability 

y(0)=o 

See  note  on  MOM  #66. 


0  50  too 


MOM  #70  Probability  that  one  shot  will  incapacitate  a  target  x  :=  0,  .01 ..  1  Probability  y(x)  :  =  .728-  atan(  5  x) 

Current  capability 

y(0)=o 

See  note  on  MOM  #66. 


0  0.5  1 


MOM#71  Coshlbtoorbit  x  :=  10000,9900..  100$/lb  y(x)  :=e'  ®“®^  ’‘ 

Current  capability 
y(  6500)  =0.039 


flO'^  5000 
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MOM  #72  Development  &  procurement  cost 


X  =20, 19.5..  .1  Billions  of  $ 


y(x)  :  = 


e 


.3x 


.97 


Current  capability 
y(10)  =0.051 


Maximum  capability  set  at  $100  billion  and  no 
capability  set  at  $20,000  billion. 


MOM  #73  Required  warning  time  x  =  100,99..  ODays  y(x)  :  = 


'Months"  (current) 
'weeks" 

'days" 

'hours" 


y(60)  =0.05 
y(14)  =0.497 
y(7)  =0.705 
y(.5)  =0.975 


MOM  #74  Inclinations  achievable  x  =0,1..  100  Percent  y(x) 

Current  capability 
y(  .3)  =0.003 


0  50  too 


X 

100 


MOM  #75  Increase  in  launch  rate  during  crisis 


X  =  0, 1 ..  100  Factor  increase 


y(x) 


X 

100 


Current  capability 
y(0)=0 
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MOM  #76  Missions  supported 
None  =  0.0 

One  mission  =  0. 1  (current) 
Two  missions  =  0.25 
Half  of  all  missions  =  0.5 
All  current  missions  =  0.9 


MOM  #77  P(soft  abort/abort)  x  :=  0, .1 ..  1  Probability  y(x)  =  x 

Current  capability 

y(0)=o 


0  0.5  1 


MOM  #78  Time  to  restart  Operations 


X  1000, 990..  0  Days  y(x)  :  =  e 

Current  Capability  (2  Years) 
y(730)  =0.026 

"Years"  set  to  1000  days 
"Months"  set  to  60  days 
"Weeks"  set  to  14  days 


MOM  #79  P(destructive  abort)  x  =  1 ,  .99 . .  0  Probability  y(  x)  =  e 


Current  capability 
y(. 05)  =0.779 
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MOM  #80  #  of  launch  locations/orbit  plane 


x:=0,.l..  10  # Locations 


X 


y(x) 


10 


MOM  #81  Ease  of  handling 

Cryogenic/toxic  =  0.0  (current) 

Part  non-toxic  =  0. 1 
Mostly  non-cryo/toxic  =  0.5 
All  non-cryo/toxic  =  0.9 

MOM  #82  Percent  blue  suit  x  := 0 , 1 ..  100 


MOM  #83  Number  and  location 
None  =  0.0 

One  coastal  site  =  0. 1  (current) 
Many  coastal  sites  =  0.5 
All  CONUS  =  0.9 


MOM  #85  Toxicity  and  waste 

High  and  mueh  =  0.0  (current) 
Mostly  dirty  =  0. 1 
Mostly  clean  =  0.5 
Glean,  low  waste  =  0.9 


Current  capability 
y(l)=0.1 


Percent  y(x)  = - 

100 

Current  capability 
y(0)=0 


MOM  #84  Similarity  of  air  operations 

Current  launch  operations  =  0. 1  (current) 
Like  Pegasus/Taurus  =  0.33 
Further  simplification  =  0.66 
Like  current  air  ops  =  0.9 


MOM  #86  Type  of  bases 

Fixed/soft  =  0.0  (current) 
Dispersed  =  0. 1 
Mobile/very  dispersed  0.5 
Very  many/mobile/hardened  =  0.9 
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MOM  #87  Maximum  liMaunch 


X 


X  =0,50..  500  xlOOOKg 


y(x) 


500 


Current  capability 
y(50)  =0.1 


The  maximum  was  increased  to  500,000  kg  to  account  for  a 
significant  improvement  over  the  past  performance  of  the  Saturn  V 
booster.  The  Saturn  V  could  put  up  a  maximum  payload  of  127,000 
kgtoLEO.  (12:731) 


MOM  #89  Average  time  to  diagnose  and  correct  a  failure 


X  =300,290..  0 Minutes  y(x) 


MOM  #90  Type  of  ground  stations 

Soft,  worldwide  =  0.1  (current) 
US  territory  =  0.25 
Mobile  backups  =  0.5 
Mainly  mobile  =  0.9 


Current  capability 
y(300)  =0,001 


MOM  #9 1  HW  failure  recovery 

Redundancy  only  =  0. 1  (current) 
Ltd.  reconfigurability  =  0.25 
Major  reconfigurability  =  0.5 
Only  minor  mission  losses  =  0.9 
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MOM  #92  Design  provisions 

None  =  0.0  (current) 

Limited  =  0. 1 
Major  =  0.5 

Mission  changes  via  SAV  =  0.9 


MOM  #94  Frequency  of  actions 

Daily  =  0.1  (current) 

Monthly  =  0.25 
Many  months  =  0.5 
Years  =  0.9 


MOM  #96  Type  of  piece  parts  required 

Specialized  =  0. 1  (current) 

Mostly  MIL-SPEC  =  0.25 
MIL-SPEC  =  0.5 
Off  the  shelf  =  0.9 


MOM  #93  Level  of  repairs  required 

Component  =  0. 1  (current) 

Board  =  0.25 
LRU  =  0.5 
SAV  only  =  0.9 


MOM  #  95  Type  of  personnel 

Contract  specialists  =  0.1  (current) 
Mix  contract  =  0.25 
High-skilled  military  =  0.5 
5 -level  =  0.9 


X  :=  100,99..  OPercent  y(x)  :=  .3442  atan(.15  x-  8) +  .50817 


Current  capability 
1  -y(lOO)  =2.87M0"® 
Rounded  to  0.0 


too  50  0 

X 

MOM#98  MTBF,  critical  part  x  ;=  100, 101 ..  200  Percent  of  system  life  y(x)  :  =  .407  atan(.054x-  8)  +  .5 


Current  capability 
y(lOO)  =0.01 


too  150  200 

X 


MOM  #97  Percent  work  value  on  site 
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MOM  #99  S/C  commonality 

System-specific  =  0.0  (current) 
Modular  subsystems  =  0. 1 
Reconfigure  designs  =  0.5 
Assemble  at  launch  site  =  0.9 


MOM  #100  S/C  interchangeability 

None  =  0.0  (current) 

Alternates  available  =  0. 1 
Standard  interface  =  0.5 
S/C  on  any  launcher  =  0.9 


MOM  #  1 0 1  Dual-use  technology 

Limited  use,  components  =  0. 1  (current) 
Expanded  use  =  0.25 
Some  dual  use  designs  =  0.5 
All  systems  dual-use  =  0.9 
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APPENDIX  C.  System  and  MOM  Scores 
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APPENDIX  D.  Mission  Area  Utilities 


Table  6.  Original  SPACECAST  2020  Data  Table  7.  Modified  Scoring  Functions  Data 


U(FE) 

U(FA) 

U(SC) 

U(SS) 

TAV 

.19647 

.38611 

.25496 

.51751 

OTV 

.06146 

.14189 

.11671 

.27941 

OMV 

.03505 

0 

.02244 

.0594 

MOD  SYS 

0 

0 

0 

.1473 

GSRT 

.17571 

.32136 

.20884 

0 

SGPS 

.08904 

.05065 

0 

0 

SPATRACS 

0 

0 

.15151 

0 

WXFOR 

.01051 

0 

.15151 

0 

SMASS 

.01453 

0 

0 

0 

ION  FOR 

.01833 

0 

0 

.0081 

HEL 

.23817 

.69752 

.49959 

.0081 

KEW 

0 

.54583 

.10397 

.0081 

HPMW 

0 

.46871 

.28282 

.0081 

PB 

0 

.23121 

.28282 

.0081 

WXCON 

.03699 

0 

0 

.0081 

SOL  MIR 

.0056 

0 

0 

.0081 

AST  DET 

0 

0 

.08239 

0 

System 

U(FE) 

U(FA) 

U(SC) 

U(SS) 

TAV 

.22283 

.39495 

.24756 

.58685 

OTV 

.09046 

.14189 

.08667 

.30945 

OMV 

.05733 

0 

.008 

.0594 

MOD  SYS 

0 

0 

0 

.14313 

GSRT 

.225 

.3135 

.21 

0 

SGPS 

.09629 

.0587 

0 

0 

SPATRACS 

0 

0 

.16556 

0 

WXFOR 

.0168 

0 

.16556 

0 

SMASS 

.0217 

0 

0 

0 

ION  FOR 

.0154 

0 

0 

.009 

HEL 

.22564 

.68795 

.48256 

.009 

KEW 

0 

.51518 

.1 

.009 

HPMW 

0 

.43551 

.282 

.009 

PB 

0 

.23516 

.282 

.009 

WXCON 

.0574 

0 

0 

.009 

SOL  MIR 

.007 

0 

0 

.009 

AST  DET 

0 

0 

.09778 

0 
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APPENDIX  E.  Mission  Area  Utility  Assessments  and  Weights 


Mission  Area 
(FE,FA,SC,SS) 

Utility 

■KEEEH 

.25 

.05 

.18 

.18 

■nUilsH 

.38 

MiliW 

.50 

.50 

.30 

MKiltilWI 

.30 

■hthliHWI 

.45 

.70 

.70 

13.  (1,0,1,1) 

.9 

14.  (0,1, 1,1) 

.65 

■WliUMI 

1.0 

E.  1  Table  8.  Mission  Area  Utility  Assessments: 


Reason 


Subjective  point  such  that  the  four  do  not  sum  to  1 


Subjective  but  taking  the  original  data  into  account 


Same  as  above 


Same  as  above 


Sum  of  1  and  2  but  synergy  increases  their  combined  value 


Sum  of  1  and  3  but  synergy  increases  their  combined  value 


Sum  of  1  and  4  ,  syner 


Sum  of  2  and  3  and  syner 


Sum  of  2  and  4,  syner 


Sum  of  3  and  4,  synergy,  and  FE+SC>SC+SS>FE+FA 


Sum  of  1,2,  and  3  and  syner 


Sum  of  1,2,  and  4,  synergy,  and  compare  w/1 1  SS=SC 


Sum  of  1,3,  and  4,  synergy,  SC>FA,  best  three-way 


FE>SS, 


1.0  Perfect  satellite  which  does  everything  oerfectl 


E.2  Table  9.  Mission  Area  Weights; 


Constant  Formula  Value 


kl  Note;l=FE  U(l, 0,0,0) _ ^ 


k2  Note:  2  =  FA  U(0,1,0,0)  .05 


k3  Note:  3 -SC  U(0, 0,1,0) _ J8 


k4  Note:4  =  SS  U(0,0,0,1)  .18 


kl2 _ U(l,l,0,0)-kl-k2 _  .08 


kl3 _ U(l,0,l,0)-kl-k3 _  .07 


kl4 _ U(l,0,0,l)-kl-k4 _  I  .07 


k23 _ U(0,l,l,0)-k2-k3 _  .07 


k24 _ U(0,l,0,l)-k2-k4 _  .07 


k34 _ U(0,0,l,l)-k3-k4  _  .09 


kl23 _ U(l,l,l,))-kl-k2-k3-kl2-kl3-k23 _  0.0 


kl24 _ U(l,l,0,l)-kl-k2-k4-kl2-kl4-k24 _  0.0 


kl34 _ U(l,0,l,l)-kl-k3-k4-kl3-kl4-k34  .06 


k234 _ U(0, 1,1,1  )-k2-k3-k4-k23-k24-k34  .01 


kl234  U(l,l,l,l)-kl23-kl24-kl34-k234-kl2-kl3-kl4-k23-k24-  -.18 

k34-kl-k2-k3-k4 
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E.3  Multiplicative  Utility  Function  k  value  derivation: 


1.  The  sum  of  the  one-way  kj’s  is  .66,  therefore  k>0i .  Zero  is  always  a  solution 
to  the  equation.  However,  the  zero  root  represents  the  case  where  the  one-way  kj’s  sum 
to  one  which  causes  the  multiplicative  function  to  collapse  to  the  additive  function. 

2.  K  is  the  positive  root  to  the  following  equation: 

(1+.25  *k)*  (1+.05  *k)*  (l+.l  8  *  itXl+.l  8*it)-yt-l  =  0 

3.  Exact  solution  (to  2  decimal  places): 

k=1.88 


Figure  17.  Root  Equation  Value  Vs  k  Values 


^  The  proof  of  this  is  in  Appendix  6B  of  Keeney  and  RaifiFa’s  book  (6:347-348). 
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